00000001:02000400:3.0F:1787560255.419288:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787560283.137841:0:3188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787560285.373005:0:3251:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 311 MB/s 00000001:01000000:2.0:1787560285.625883:0:3251:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 500 MB/s 00000001:01000000:2.0:1787560285.875916:0:3251:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5775 MB/s 00000020:02000000:3.0:1787560286.624103:0:3280:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_82_g4029ffa 00000400:02000000:2.0:1787560287.775040:0:3295:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.156@tcp [8/256/0/180] 00008000:02000000:0.0F:1787560292.018689:0:3445:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1787560342.571202:0:5245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787560356.372402:0:5819:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787560356.372408:0:5819:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787560356.372555:0:5819:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e01d4cbf 00000080:02000400:0.0:1787560356.372567:0:5819:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787560356.383499:0:5819:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787560356.383512:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787560356.387180:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000866945e4) 00000020:00000080:3.0:1787560356.387207:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787560356.421292:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787560356.422609:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787560356.448239:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787560356.448277:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787560356.448296:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787560356.448426:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787560356.448577:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787560356.448991:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787560356.448999:0:5819:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787560356.449009:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ec19 00000020:01000004:2.0:1787560356.449017:0:5819:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787560356.449021:0:5819:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787560356.449025:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e01d4cbf from MGS 00000020:01000004:2.0:1787560356.449029:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787560356.449051:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005e2f0365) 00000020:00000080:2.0:1787560356.449063:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787560356.449127:0:5819:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e01d4cbf from MGS, refs=2 00080000:01000000:2.0:1787560356.449133:0:5819:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787560356.449137:0:5819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ec27 00000100:00100000:2.0:1787560356.449227:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787560356.449590:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787560356.449596:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787560356.450455:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787560356.450462:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787560356.451643:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560356.452009:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787560356.452015:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787560356.453129:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787560356.453136:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787560356.453645:0:5819:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787560356.453653:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787560356.454288:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560356.454291:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560356.454293:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560356.461318:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560356.461333:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560356.461335:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560356.462155:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787560356.473923:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787560356.712831:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1637 MB/s 00000001:01000000:2.0:1787560356.963744:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1639 MB/s 00000001:01000000:2.0:1787560357.213002:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 311 MB/s 00000001:01000000:3.0:1787560357.469017:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 464 MB/s 00080000:10000000:3.0:1787560357.487607:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1787560357.519004:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787560357.532242:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787560357.532270:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787560357.532273:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787560357.545043:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787560357.545158:0:5819:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787560357.545218:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787560357.545446:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787560357.545473:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787560357.548642:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560357.549296:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787560357.549304:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787560357.550691:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787560357.550699:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787560357.551661:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787560357.552462:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787560357.563478:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787560357.563501:0:5819:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.156@tcp' 00000020:01000004:2.0:1787560357.563503:0:5819:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787560357.563568:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.156@tcp (typ=mgc) 00000020:00000080:2.0:1787560357.563579:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.156@tcp (00000000d4083ae4) 00000020:00000080:2.0:1787560357.563593:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787560357.563689:0:5819:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000373fa0fa@MGC192.168.201.156@tcp: add connection 192.168.201.156@tcp at head 00010000:00010000:2.0:1787560357.563885:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.156@tcp-0 is initialized 00000040:01000000:2.0:1787560357.563891:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787560357.564461:0:5834:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787560357.577465:0:5836:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787560357.577699:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.156@tcp (uuid ba37d386-11cd-48cd-b42f-22b3cfa8191f) 00000020:00000080:0.0:1787560357.577726:0:5819:0:(genops.c:1385:class_connect()) connect: client ba37d386-11cd-48cd-b42f-22b3cfa8191f, cookie 0xe34191b05673ec35 00000100:00080000:0.0:1787560357.577737:0:5819:0:(import.c:510:import_select_connection()) MGC192.168.201.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560357.577743:0:5819:0:(import.c:624:import_select_connection()) MGC192.168.201.156@tcp: import 00000000373fa0fa using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1787560357.577812:0:5819:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000020e03dac x1874392815501440/t0(0) o250->MGC192.168.201.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787560357.577839:0:5819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS 00000020:01000004:0.0:1787560357.577879:0:5819:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787560357.577884:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787560357.577904:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ec77399f) 00000020:00000080:0.0:1787560357.577918:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787560357.580096:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020e03dac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3310:1874392815501440:0@lo:250: 00000100:00100000:1.0:1787560357.580187:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560357.580258:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815501440 00000100:00100000:1.0:1787560357.580266:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815501440 00000100:00100000:1.0:1787560357.580303:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560357.580309:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000579021ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874392815501440:12345-0@lo:250: 00010000:00080000:1.0:1787560357.580332:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ba37d386-11cd-48cd-b42f-22b3cfa8191f@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:1.0:1787560357.580356:0:5831:0:(genops.c:1385:class_connect()) connect: client ba37d386-11cd-48cd-b42f-22b3cfa8191f, cookie 0xe34191b05673ec43 00000100:00080000:1.0:1787560357.580469:0:5831:0:(import.c:65:import_set_state_nolock()) 000000009b88c143 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560357.580539:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000579021ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:3310:x1874392815501440:12345-0@lo:250: Request processed in 228us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560357.580546:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560357.580592:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787560357.580600:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.156@tcp: connect to target with instance 0 00000100:00080000:1.0:1787560357.580606:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787560357.580610:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787560357.580613:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000373fa0fa MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787560357.580615:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787560357.580627:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787560357.580633:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020e03dac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3310:1874392815501440:0@lo:250: 00000100:00100000:0.0:1787560357.608226:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560357.608418:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787560357.608425:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787560357.612658:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787560357.613047:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787560357.613426:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787560357.613432:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787560357.614586:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560357.615315:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787560357.615321:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787560357.616268:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787560357.616275:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787560357.675469:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560357.678283:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787560357.678292:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787560357.682397:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787560357.682411:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787560357.683540:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560357.683741:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787560357.683745:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787560357.686644:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787560357.686656:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787560357.687495:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560357.688047:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787560357.688054:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787560357.688575:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787560357.688581:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787560357.701619:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560357.702170:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787560357.702176:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787560357.708543:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787560357.708563:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787560357.765198:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560357.765405:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787560357.765411:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787560357.772164:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787560357.772195:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787560357.774969:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787560357.774982:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787560357.780059:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787560357.780092:0:5819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787560357.780109:0:5819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787560357.780247:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787560357.780280:0:5819:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787560357.780284:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787560357.780286:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560357.780287:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560357.780289:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560357.780290:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560357.780291:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560357.780292:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560357.780294:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560357.780295:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560357.780296:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560357.780298:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560357.780299:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560357.780302:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787560357.780304:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560357.780305:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560357.780306:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560357.780307:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560357.780308:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560357.780309:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560357.780309:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560357.780310:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560357.780311:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560357.780312:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560357.780313:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560357.780314:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560357.780346:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787560357.780364:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7c14133 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815501568:0@lo:253: 00000100:00100000:2.0:1787560357.780453:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560357.780614:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000005917edc9 going to sleep for 11 seconds 00000100:00100000:0.0:1787560357.782068:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815501568 00000100:00100000:0.0:1787560357.782078:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815501568 00000100:00100000:0.0:1787560357.782134:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560357.782143:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b8ca6ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:5819:x1874392815501568:12345-0@lo:253: 20000000:01000000:0.0:1787560357.782189:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787560357.782192:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787560357.789430:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787560357.789574:0:5833:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787560357.789902:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560357.791457:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787560357.792148:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787560357.792153:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787560357.792160:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787560357.792163:0:5833:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787560357.792180:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787560357.792400:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560357.792668:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787560357.792699:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787560357.792747:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787560357.793196:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787560357.793235:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787560357.793317:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787560357.793325:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787560357.793360:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787560357.793366:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787560357.793390:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787560357.793396:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787560357.793419:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787560357.793466:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787560357.793496:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787560357.793502:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787560357.793514:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560357.793709:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787560357.793718:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787560357.793747:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787560357.793773:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787560357.793818:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787560357.793827:0:5833:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787560357.793902:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787560357.793910:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787560357.793948:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787560357.794000:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787560357.794036:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787560357.794047:0:5833:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787560357.794128:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787560357.794137:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787560357.794170:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787560357.794205:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787560357.794346:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787560357.794384:0:5833:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787560357.794390:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787560357.795753:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787560357.796116:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787560357.796141:0:5833:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.156@tcp for mdt 20000000:01000000:0.0:1787560357.796144:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.156@tcp (null) (null) (null) 00000040:00080000:0.0:1787560357.796181:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787560357.796189:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787560357.796220:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787560357.796228:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.156@tcp (null) (null) 00000040:00080000:0.0:1787560357.796275:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787560357.796284:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787560357.796329:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787560357.796370:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787560357.796423:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787560357.796427:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787560357.796430:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787560357.796440:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787560357.796442:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787560357.796469:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787560357.796471:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787560357.797402:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787560357.797716:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787560357.797750:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787560357.797968:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787560357.797983:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787560357.797985:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787560357.798374:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787560357.798573:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787560357.798622:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787560357.798657:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1787560357.798688:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787560357.798690:0:5833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787560357.798694:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787560357.798696:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787560357.798701:0:5833:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787560357.798706:0:5833:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787560357.799470:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787560357.800053:0:5833:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787560357.810343:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787560357.810396:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787560357.810465:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787560357.810496:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787560357.810525:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560357.810541:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560357.810552:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560357.810558:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560357.810564:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560357.810570:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560357.810592:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d525c5f5 already unused, calling callback (00000000a426df81) 00010000:00010000:0.0:1787560357.810596:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560357.810603:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560357.810616:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560357.810623:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560357.810628:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d525c5f5/0xe34191b05673ec4a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787560357.810645:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787560358.203890:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b8ca6ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:5819:x1874392815501568:12345-0@lo:253: Request processed in 421740us (423430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560358.203909:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560358.204059:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7c14133 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815501568:0@lo:253: 10000000:01000000:3.0:1787560358.204075:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787560358.204078:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787560358.204080:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787560358.204082:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560358.204083:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787560358.204084:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560358.204099:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560358.204100:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787560358.204101:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787560358.204103:0:5819:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787560358.204104:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560358.204105:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787560358.204121:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e01d4cbf from lustre-MDT0000 10000000:01000000:3.0:1787560358.204154:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787560358.204158:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787560358.204163:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93d9901ecd28 10000000:01000000:3.0:1787560358.204167:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560358.204175:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d9901ecd28 from 1 10000000:01000000:3.0:1787560358.204178:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787560358.204227:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 0000000041bac36f/0xe34191b05673ec51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.204237:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 0000000041bac36f/0xe34191b05673ec51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.204245:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 0000000041bac36f/0xe34191b05673ec51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.204262:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815501696:0@lo:101: 00000100:00100000:3.0:1787560358.204299:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.204350:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b6bd3d6 going to sleep for 11 seconds 00000100:00100000:2.0:1787560358.204804:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815501696 00000100:00100000:2.0:1787560358.204817:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815501696 00000100:00100000:2.0:1787560358.204881:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560358.204889:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a362ce8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:5819:x1874392815501696:12345-0@lo:101: 00010000:00010000:2.0:1787560358.204901:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560358.204916:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001e9fb84b/0xe34191b05673ec58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ec51 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560358.204936:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e9fb84b/0xe34191b05673ec58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ec51 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560358.204945:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001e9fb84b/0xe34191b05673ec58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ec51 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560358.204953:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001e9fb84b, rc 0) 00000100:00100000:2.0:1787560358.204985:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a362ce8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+6:5819:x1874392815501696:12345-0@lo:101: Request processed in 97us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560358.204991:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560358.205143:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815501696:0@lo:101: 00010000:00010000:3.0:1787560358.205156:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 0000000041bac36f/0xe34191b05673ec51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.205164:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 0000000041bac36f/0xe34191b05673ec51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.205220:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815501824:0@lo:501: 00000100:00100000:3.0:1787560358.205247:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.205273:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b6bd3d6 going to sleep for 11 seconds 00000100:00100000:2.0:1787560358.205381:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815501824 00000100:00100000:2.0:1787560358.205385:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815501824 00000100:00100000:2.0:1787560358.205421:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560358.205427:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3ae6204 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+6:5819:x1874392815501824:12345-0@lo:501: 00000100:00100000:2.0:1787560358.205661:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3ae6204 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+6:5819:x1874392815501824:12345-0@lo:501: Request processed in 233us (413us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560358.205685:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560358.206078:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815501824:0@lo:501: 10000000:01000000:3.0:1787560358.206102:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787560358.206119:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 0000000041bac36f/0xe34191b05673ec51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.206127:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 0000000041bac36f/0xe34191b05673ec51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560358.206145:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d982bfc800 10000000:01000000:3.0:1787560358.206149:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787560358.206153:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93d982bfc800 10000000:01000000:3.0:1787560358.206156:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787560358.206159:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93d982bfc800 from 1 10000000:01000000:3.0:1787560358.206161:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787560358.206180:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 000000003b813d87/0xe34191b05673ec5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.206188:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 000000003b813d87/0xe34191b05673ec5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.206196:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 000000003b813d87/0xe34191b05673ec5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.206209:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815501952:0@lo:101: 00000100:00100000:3.0:1787560358.206246:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.206270:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b6bd3d6 going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.206290:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815501952 00000100:00100000:3.0:1787560358.206294:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815501952 00000100:00100000:3.0:1787560358.206319:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560358.206324:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3691ea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+6:5819:x1874392815501952:12345-0@lo:101: 00010000:00010000:3.0:1787560358.206332:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560358.206343:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008818c9eb/0xe34191b05673ec66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ec5f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.206356:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008818c9eb/0xe34191b05673ec66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ec5f expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.206364:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008818c9eb/0xe34191b05673ec66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ec5f expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.206371:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008818c9eb, rc 0) 00000100:00100000:3.0:1787560358.206399:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3691ea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+7:5819:x1874392815501952:12345-0@lo:101: Request processed in 74us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.206417:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560358.206945:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815501952:0@lo:101: 00010000:00010000:3.0:1787560358.206959:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 000000003b813d87/0xe34191b05673ec5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.206967:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 000000003b813d87/0xe34191b05673ec5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560358.206979:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787560358.206982:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 000000003b813d87/0xe34191b05673ec5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.206996:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 000000003b813d87/0xe34191b05673ec5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560358.207003:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787560358.207007:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560358.207011:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93d982bfc800 10000000:01000000:3.0:1787560358.207013:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787560358.207015:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787560358.207017:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787560358.207032:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 000000003a2e316b/0xe34191b05673ec6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.207038:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 000000003a2e316b/0xe34191b05673ec6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.207044:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 000000003a2e316b/0xe34191b05673ec6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.207055:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502080:0@lo:101: 00000100:00100000:3.0:1787560358.207082:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.207102:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aab24574 going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.207118:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815502080 00000100:00100000:3.0:1787560358.207122:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815502080 00000100:00100000:3.0:1787560358.207160:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560358.207166:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce362d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+7:5819:x1874392815502080:12345-0@lo:101: 00010000:00010000:3.0:1787560358.207173:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560358.207180:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d47acd0c/0xe34191b05673ec74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ec6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.207206:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d47acd0c/0xe34191b05673ec74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ec6d expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.207213:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d47acd0c/0xe34191b05673ec74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ec6d expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.207218:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d47acd0c, rc 0) 00000100:00100000:3.0:1787560358.207261:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce362d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+8:5819:x1874392815502080:12345-0@lo:101: Request processed in 95us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.207267:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560358.207305:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502080:0@lo:101: 00010000:00010000:3.0:1787560358.207315:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 000000003a2e316b/0xe34191b05673ec6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.207321:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 000000003a2e316b/0xe34191b05673ec6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.207359:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502208:0@lo:501: 00000100:00100000:3.0:1787560358.207383:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.207396:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aab24574 going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.207910:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815502208 00000100:00100000:3.0:1787560358.207915:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815502208 00000100:00100000:3.0:1787560358.207940:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560358.207946:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b16c10e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+8:5819:x1874392815502208:12345-0@lo:501: 00000100:00100000:3.0:1787560358.208181:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b16c10e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+9:5819:x1874392815502208:12345-0@lo:501: Request processed in 234us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.208188:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560358.208237:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502208:0@lo:501: 00000100:00100000:3.0:1787560358.208264:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502336:0@lo:503: 00000100:00100000:3.0:1787560358.208304:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.208325:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aab24574 going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.208336:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815502336 00000100:00100000:3.0:1787560358.208340:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815502336 00000100:00100000:3.0:1787560358.208360:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560358.208366:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a683e0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+9:5819:x1874392815502336:12345-0@lo:503: 00000100:00100000:3.0:1787560358.209387:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a683e0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+9:5819:x1874392815502336:12345-0@lo:503: Request processed in 1017us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.209397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560358.210016:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b171df87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502336:0@lo:503: 00000100:00100000:0.0:1787560358.210758:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b46b4f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5860:1874392815502464:0@lo:502: 00000100:00100000:0.0:1787560358.210893:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560358.211321:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 00000000644a7ccd going to sleep for 11 seconds 00000100:00100000:2.0:1787560358.211368:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815502464 00000100:00100000:2.0:1787560358.211377:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815502464 00000100:00100000:2.0:1787560358.211578:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560358.211588:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e34f135 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+9:5860:x1874392815502464:12345-0@lo:502: 00000100:00100000:2.0:1787560358.213365:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e34f135 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+9:5860:x1874392815502464:12345-0@lo:502: Request processed in 1773us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560358.213380:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560358.213634:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b46b4f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5860:1874392815502464:0@lo:502: 00000020:01000000:0.0:1787560358.213669:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560358.213681:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560358.213683:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787560358.213688:0:5860:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787560358.213691:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560358.213705:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003e4eac54) 00000020:00000080:0.0:1787560358.213724:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787560358.214035:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787560358.214723:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787560358.214734:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ec82 00000020:00000080:0.0:1787560358.215020:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787560358.215025:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560358.215029:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560358.215031:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787560358.215034:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560358.215038:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560358.215039:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787560358.215043:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560358.215051:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000098eb376c) 00000020:00000080:0.0:1787560358.215062:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787560358.215066:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787560358.215067:0:5860:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787560358.215070:0:5860:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787560358.215075:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787560358.215118:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e01d4cbf from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787560358.215140:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a3a12b5e) 00000020:00000080:0.0:1787560358.215148:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787560358.215204:0:5860:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787560358.215209:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe34191b05673ec97 00000020:00000080:0.0:1787560358.215282:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787560358.215287:0:5860:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787560358.215291:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe34191b05673ec9e 00080000:01000000:0.0:1787560358.215295:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787560358.215298:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673eca5 00080000:10000000:1.0:1787560358.216319:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787560358.216933:0:5860:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787560358.225016:0:5860:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787560358.345184:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787560358.347179:0:5860:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787560358.349241:0:5860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787560358.349497:0:5860:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787560358.420639:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004d6d08c9) 00000020:00000080:3.0:1787560358.420661:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787560358.420720:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787560358.420727:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ecb3 00000020:00000080:3.0:1787560358.432731:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787560358.438796:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00010000:00010000:1.0:1787560358.552278:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1787560358.572387:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560358.605194:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560358.631148:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560358.666796:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787560358.715649:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787560358.773631:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe34191b05673ecba 00000020:00000080:0.0:1787560358.773953:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787560358.773962:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560358.773968:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560358.773970:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787560358.773972:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560358.773980:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560358.773982:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787560358.773984:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787560358.773985:0:5860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787560358.773988:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560358.773990:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560358.773991:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787560358.773992:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560358.773997:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560358.773998:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787560358.774001:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787560358.774041:0:5860:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787560358.774092:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b46b4f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5860:1874392815502592:0@lo:502: 00000100:00100000:0.0:1787560358.774161:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560358.774197:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 0000000039b2b2c7 going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.774388:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815502592 00000100:00100000:3.0:1787560358.774395:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815502592 00000100:00100000:3.0:1787560358.774437:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560358.774444:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb5245c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+9:5860:x1874392815502592:12345-0@lo:502: 00000100:00100000:3.0:1787560358.774721:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb5245c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+9:5860:x1874392815502592:12345-0@lo:502: Request processed in 277us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.774728:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560358.774930:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b46b4f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5860:1874392815502592:0@lo:502: 00000020:01000000:0.0:1787560358.774953:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560358.774957:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560358.774958:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787560358.774961:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787560358.775157:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787560358.775174:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787560358.775188:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 000000003a2e316b/0xe34191b05673ec6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.775197:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 000000003a2e316b/0xe34191b05673ec6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560358.775204:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d982bfc800 from 1 10000000:01000000:3.0:1787560358.775206:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787560358.775229:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.775236:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.775243:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.775252:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a19a23e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502720:0@lo:101: 00000100:00100000:3.0:1787560358.775275:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.775305:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f71895f going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.775322:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815502720 00000100:00100000:3.0:1787560358.775326:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815502720 00000100:00100000:3.0:1787560358.775343:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560358.775347:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa693f75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+9:5819:x1874392815502720:12345-0@lo:101: 00010000:00010000:3.0:1787560358.775354:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560358.775364:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000416b2528/0xe34191b05673ecc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ecc1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.775389:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000416b2528/0xe34191b05673ecc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ecc1 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.775396:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000416b2528/0xe34191b05673ecc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ecc1 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.775403:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000416b2528, rc 0) 00000100:00100000:3.0:1787560358.775425:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa693f75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+10:5819:x1874392815502720:12345-0@lo:101: Request processed in 78us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.775430:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560358.775455:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a19a23e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502720:0@lo:101: 00010000:00010000:3.0:1787560358.775463:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.775471:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.776023:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a19a23e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502848:0@lo:256: 00000100:00100000:3.0:1787560358.776050:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560358.776296:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815502848 00000100:00100000:0.0:1787560358.776300:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815502848 00000100:00100000:0.0:1787560358.776321:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560358.776326:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005addcd12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+10:5819:x1874392815502848:12345-0@lo:256: 20000000:01000000:0.0:1787560358.776338:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787560358.776343:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787560358.776389:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005addcd12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+10:5819:x1874392815502848:12345-0@lo:256: Request processed in 63us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560358.776394:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560358.776475:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f71895f going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.776487:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a19a23e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502848:0@lo:256: 10000000:01000000:3.0:1787560358.777362:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787560358.777410:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.777418:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560358.777433:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d982bfc800 from 1 10000000:01000000:3.0:1787560358.777435:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787560358.777466:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.777473:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.777481:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.777495:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a19a23e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502976:0@lo:101: 00000100:00100000:3.0:1787560358.777540:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.777571:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f71895f going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.777590:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815502976 00000100:00100000:3.0:1787560358.777595:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815502976 00000100:00100000:3.0:1787560358.777625:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560358.777632:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cef0b5ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+10:5819:x1874392815502976:12345-0@lo:101: 00010000:00010000:3.0:1787560358.777640:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560358.777651:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c0494a0/0xe34191b05673ecd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673eccf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.777666:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c0494a0/0xe34191b05673ecd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673eccf expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.777673:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c0494a0/0xe34191b05673ecd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673eccf expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.777679:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c0494a0, rc 0) 00000100:00100000:3.0:1787560358.777710:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cef0b5ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:5819:x1874392815502976:12345-0@lo:101: Request processed in 79us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.777715:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560358.777746:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a19a23e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815502976:0@lo:101: 00010000:00010000:3.0:1787560358.777765:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.777772:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.777811:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a19a23e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815503104:0@lo:501: 00000100:00100000:3.0:1787560358.777835:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.777877:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f71895f going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.777887:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815503104 00000100:00100000:3.0:1787560358.777890:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815503104 00000100:00100000:3.0:1787560358.777907:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787560358.777911:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000370a9bb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:5819:x1874392815503104:12345-0@lo:501: 00000100:00100000:3.0:1787560358.778710:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000370a9bb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:5819:x1874392815503104:12345-0@lo:501: Request processed in 797us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.778718:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560358.778911:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a19a23e pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815503104:0@lo:501: 00000100:00100000:1.0:1787560358.778955:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056b080d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815503232:0@lo:503: 00000100:00100000:1.0:1787560358.778998:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560358.779037:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000672b74d2 going to sleep for 11 seconds 00000100:00100000:0.0:1787560358.779188:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815503232 00000100:00100000:0.0:1787560358.779199:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815503232 00000100:00100000:0.0:1787560358.779229:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560358.779236:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000707edc48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:5819:x1874392815503232:12345-0@lo:503: 00000040:00080000:0.0:1787560358.779270:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787560358.779320:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000707edc48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:5819:x1874392815503232:12345-0@lo:503: Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560358.779326:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560358.779359:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056b080d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815503232:0@lo:503: 00000040:00080000:0.0:1787560358.780567:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787560358.780693:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787560358.780709:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560358.780896:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.780906:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560358.780945:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787560358.780948:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d982bfc800 10000000:01000000:1.0:1787560358.780950:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d982bfc800 10000000:01000000:1.0:1787560358.780953:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787560358.780957:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d982bfc800 from 1 10000000:01000000:1.0:1787560358.780959:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787560358.780985:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 0000000081dec949/0xe34191b05673ecdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.780991:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 0000000081dec949/0xe34191b05673ecdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.780999:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 0000000081dec949/0xe34191b05673ecdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560358.781195:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a229c97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815503360:0@lo:101: 00000100:00100000:1.0:1787560358.781237:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560358.781267:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b86b472 going to sleep for 11 seconds 00000100:00100000:0.0:1787560358.781355:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815503360 00000100:00100000:0.0:1787560358.781361:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815503360 00000100:00100000:0.0:1787560358.781394:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560358.781400:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b87b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:5819:x1874392815503360:12345-0@lo:101: 00010000:00010000:0.0:1787560358.781410:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560358.781418:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d525c5f5/0xe34191b05673ece4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ecdd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560358.781435:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d525c5f5/0xe34191b05673ece4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ecdd expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560358.781442:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d525c5f5/0xe34191b05673ece4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ecdd expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560358.781448:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d525c5f5, rc 0) 00000100:00100000:0.0:1787560358.781483:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b87b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5819:x1874392815503360:12345-0@lo:101: Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560358.781488:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787560358.781552:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a229c97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815503360:0@lo:101: 00010000:00010000:3.0:1787560358.781562:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 0000000081dec949/0xe34191b05673ecdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.781569:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 0000000081dec949/0xe34191b05673ecdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.781608:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b643d2b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815503488:0@lo:501: 00000100:00100000:3.0:1787560358.781638:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.781657:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095e2b0cc going to sleep for 11 seconds 00000100:00100000:0.0:1787560358.781691:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815503488 00000100:00100000:0.0:1787560358.781699:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815503488 00000100:00100000:0.0:1787560358.781723:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560358.781727:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014690934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5819:x1874392815503488:12345-0@lo:501: 00000100:00100000:0.0:1787560358.781949:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014690934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5819:x1874392815503488:12345-0@lo:501: Request processed in 221us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560358.781955:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787560358.782077:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b643d2b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815503488:0@lo:501: 00000100:00100000:3.0:1787560358.782098:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b643d2b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815503616:0@lo:503: 00000100:00100000:3.0:1787560358.782126:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.782146:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095e2b0cc going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.782157:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815503616 00000100:00100000:3.0:1787560358.782160:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815503616 00000100:00100000:3.0:1787560358.782174:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560358.782178:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e21eeb26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5819:x1874392815503616:12345-0@lo:503: 00000100:00100000:3.0:1787560358.782363:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e21eeb26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5819:x1874392815503616:12345-0@lo:503: Request processed in 184us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.782368:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560358.782407:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b643d2b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815503616:0@lo:503: 00000100:00100000:3.0:1787560358.782546:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b643d2b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5865:1874392815503744:0@lo:502: 00000100:00100000:3.0:1787560358.782572:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.782587:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815503744 00000100:00100000:3.0:1787560358.782589:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815503744 00000100:00100000:3.0:1787560358.782602:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560358.782606:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db427d89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5865:x1874392815503744:12345-0@lo:502: 00000100:00100000:3.0:1787560358.782730:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db427d89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5865:x1874392815503744:12345-0@lo:502: Request processed in 123us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.782735:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560358.782940:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021eb25ea going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.782951:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b643d2b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5865:1874392815503744:0@lo:502: 00000020:01000004:3.0:1787560358.782998:0:5865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787560358.783010:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c3b25636) 00000020:00000080:3.0:1787560358.783024:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787560358.783131:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e01d4cbf from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787560358.783134:0:5865:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e01d4cbf from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787560358.783137:0:5865:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e01d4cbf 4 00010000:00080000:3.0:1787560358.783159:0:5865:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008767b8ac@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.156@tcp at head 00010000:00010000:3.0:1787560358.785194:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787560358.785405:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787560358.785431:0:5865:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787560358.785439:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe34191b05673ecf2 00000100:00080000:3.0:1787560358.785447:0:5865:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560358.785451:0:5865:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008767b8ac using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1787560358.785476:0:5865:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b643d2b6 x1874392815503872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560358.785506:0:5865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787560358.786243:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b643d2b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874392815503872:0@lo:38: 00000100:00100000:1.0:1787560358.786308:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.786555:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003473619c pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5865:1874392815504000:0@lo:502: 00000100:00100000:3.0:1787560358.786598:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560358.786624:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f71895f going to sleep for 11 seconds 00000100:00100000:1.0:1787560358.786767:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815504000 00000100:00100000:1.0:1787560358.786774:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815504000 00000100:00100000:1.0:1787560358.786817:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787560358.786825:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000898580ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5865:x1874392815504000:12345-0@lo:502: 00000100:00100000:2.0:1787560358.787212:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815503872 00000100:00100000:2.0:1787560358.787218:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815503872 00000100:00100000:2.0:1787560358.787240:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560358.787245:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000882813b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874392815503872:12345-0@lo:38: 00000100:00100000:2.0:1787560358.787307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000882813b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874392815503872:12345-0@lo:38: Request processed in 61us (998us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787560358.787314:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560358.787363:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787560358.787370:0:3310:0:(import.c:65:import_set_state_nolock()) 000000008767b8ac lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560358.787373:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787560358.787376:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b643d2b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874392815503872:0@lo:38: 00000100:00100000:1.0:1787560358.787530:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000898580ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5865:x1874392815504000:12345-0@lo:502: Request processed in 705us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560358.787536:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560358.787610:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003473619c pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5865:1874392815504000:0@lo:502: 00000040:00080000:2.0:1787560358.787629:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787560358.788169:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787560358.788185:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787560358.788200:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 0000000081dec949/0xe34191b05673ecdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.788209:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 0000000081dec949/0xe34191b05673ecdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787560358.788247:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787560358.788249:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787560358.788250:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560358.788251:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560358.788252:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560358.788253:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560358.788255:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787560358.788256:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787560358.788257:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560358.788258:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560358.788259:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560358.788260:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787560358.788263:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787560358.788265:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787560358.788266:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787560358.788266:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560358.788267:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560358.788268:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560358.788269:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560358.788273:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787560358.788273:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787560358.788274:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560358.788275:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560358.788275:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560358.788276:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787560358.788370:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787560358.788380:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc6d2a83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815504128:0@lo:253: 00000100:00100000:1.0:1787560358.788409:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560358.788461:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd4a1045 going to sleep for 11 seconds 00000100:00100000:2.0:1787560358.792676:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815504128 00000100:00100000:2.0:1787560358.792690:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815504128 00000100:00100000:3.0:1787560358.794712:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787560358.794727:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f48caa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5819:x1874392815504128:12345-0@lo:253: 20000000:01000000:3.0:1787560358.794893:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787560358.794907:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787560358.832485:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787560358.832507:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787560358.832553:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787560358.832558:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787560358.832576:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560358.832592:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000416b2528/0xe34191b05673ecc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ecc1 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560358.832599:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560358.832635:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000416b2528/0xe34191b05673ecc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ecc1 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560358.832646:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000416b2528/0xe34191b05673ecc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ecc1 expref: 12 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560358.832658:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b46b4f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874392815504256:0@lo:104: 00000100:00100000:0.0:1787560358.832715:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560358.832770:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d940231d going to sleep for 11 seconds 00000100:00100000:3.0:1787560358.833213:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815504256 00000100:00100000:3.0:1787560358.833221:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815504256 00000100:00100000:3.0:1787560358.833262:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560358.833280:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d0b2cb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5853:x1874392815504256:12345-0@lo:104: 00010000:00010000:3.0:1787560358.833301:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560358.833346:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560358.833350:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d0b2cb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5853:x1874392815504256:12345-0@lo:104: Request processed in 72us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.833356:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560358.833516:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b46b4f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874392815504256:0@lo:104: 00010000:00010000:0.0:1787560358.833531:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840371:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560358.840383:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840394:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ef1e1d0a already unused, calling callback (00000000ce196a8e) 10000000:00010000:1.0:1787560358.840397:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840405:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560358.840410:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560358.840414:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560358.840460:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840465:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560358.840479:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840484:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: 00000000ef1e1d0a/0xe34191b05673ecc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ecc8 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840526:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560358.840527:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560358.840529:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560358.840596:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0b62b4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815504384:0@lo:103: 00000100:00100000:1.0:1787560358.840654:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560358.840750:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815504384 00000100:00100000:1.0:1787560358.840758:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815504384 00010000:00010000:1.0:1787560358.840783:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000416b2528/0xe34191b05673ecc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ecc1 expref: 13 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560358.840810:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560358.840818:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4e5eaa0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:3312:x1874392815504384:12345-0@lo:103: 00010000:00010000:1.0:1787560358.840829:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560358.840832:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000416b2528/0xe34191b05673ecc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ecc1 expref: 13 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840842:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000416b2528/0xe34191b05673ecc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ecc1 expref: 13 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840881:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000416b2528/0xe34191b05673ecc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ecc1 expref: 13 pid: 5833 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840895:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840901:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787560358.840915:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008357731s 00010000:00010000:1.0:1787560358.840925:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840931:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840936:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840942:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840947:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088bf4ec2 already unused, calling callback (00000000a426df81) 00010000:00010000:1.0:1787560358.840950:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840956:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840969:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.840979:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560358.841013:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4e5eaa0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:3312:x1874392815504384:12345-0@lo:103: Request processed in 195us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560358.841020:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560358.841696:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0b62b4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815504384:0@lo:103: 00010000:00010000:1.0:1787560358.841724:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.841731:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560358.841741:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000088bf4ec2/0xe34191b05673ecf9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560358.870650:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f48caa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:5819:x1874392815504128:12345-0@lo:253: Request processed in 75921us (82232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560358.870663:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560358.871234:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc6d2a83 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5819:1874392815504128:0@lo:253: 10000000:01000000:2.0:1787560358.871251:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787560358.871254:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560358.871256:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560358.871257:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560358.871258:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560358.871260:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560358.871261:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560358.871262:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560358.871274:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560358.871275:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560358.871276:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560358.871277:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560358.871278:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787560358.871300:0:5819:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787560358.877184:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787560358.877426:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787560358.877594:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787560358.877697:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787560358.878126:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787560358.878233:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787560358.883650:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787560358.884149:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787560358.884363:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787560358.884480:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787560358.884685:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787560358.885234:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787560358.965041:0:5819:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787560359.127659:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787560359.127830:0:5870:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787560359.127836:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787560359.128308:0:5871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787560359.131829:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787560359.131993:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787560359.132321:0:5819:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787560359.132330:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787560359.132413:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560359.133310:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787560359.137818:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787560359.137904:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787560359.139638:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787560359.139990:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787560359.144938:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787560359.145106:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787560359.145884:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787560359.146070:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787560359.146231:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787560359.146699:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787560359.147075:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787560359.147241:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787560359.147451:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787560359.147666:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787560359.148039:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787560359.148195:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787560359.148652:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787560359.148829:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787560359.148993:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787560359.149157:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787560359.149654:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787560359.150243:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787560359.151191:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787560359.151357:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787560359.152349:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787560359.152667:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787560359.153349:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787560359.153722:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787560359.154179:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787560359.157696:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787560359.158060:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787560359.158231:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787560359.158936:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787560359.159119:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787560359.159261:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787560359.159423:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787560359.160555:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787560359.202611:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787560359.307953:0:5819:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787560359.307988:0:5819:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb1f01dbf988 00100000:10000000:1.0:1787560359.308007:0:5819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787560359.309034:0:5819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787560359.309048:0:5819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787560359.309062:0:5819:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787560359.309115:0:5819:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787560359.422206:0:5871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787560359.422291:0:5871:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787560359.422295:0:5871:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787560359.568334:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560360.600480:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560361.615565:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560362.650643:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560363.669288:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560364.239900:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787560364.239911:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787560364.239913:0:36:0:(import.c:65:import_set_state_nolock()) 000000008767b8ac lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560364.239926:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008767b8ac using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1787560364.239947:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a0175588 x1874392815504640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560364.239987:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0175588 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874392815504640:0@lo:38: 00000100:00100000:3.0:1787560364.240073:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560364.240304:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3771fa4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815504512:0@lo:400: 00000100:00100000:2.0:1787560364.240354:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560364.240501:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815504512 00000100:00100000:3.0:1787560364.240522:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815504512 00000100:00100000:3.0:1787560364.240571:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787560364.240580:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054d19623 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:3313:x1874392815504512:12345-0@lo:400: 00000100:00100000:3.0:1787560364.240627:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054d19623 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:3313:x1874392815504512:12345-0@lo:400: Request processed in 49us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560364.240634:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787560364.240783:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3771fa4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815504512:0@lo:400: 00000100:00100000:0.0:1787560364.241670:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815504640 00000100:00100000:0.0:1787560364.241693:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815504640 00000100:00100000:0.0:1787560364.241727:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560364.241733:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054ccf605 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874392815504640:12345-0@lo:38: 00010000:00080000:0.0:1787560364.241756:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1787560364.241789:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe34191b05673ed00 00000004:00100000:0.0:1787560364.241832:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787560364.241961:0:5839:0:(import.c:65:import_set_state_nolock()) 00000000785aa63b : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560364.242014:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054ccf605 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874392815504640:12345-0@lo:38: Request processed in 280us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560364.242021:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787560364.242492:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a0175588 x1874392815504640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787560364.242507:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787560364.242514:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787560364.242518:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787560364.242520:0:3310:0:(import.c:65:import_set_state_nolock()) 000000008767b8ac lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787560364.242526:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0175588 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874392815504640:0@lo:38: 00010000:00010000:1.0:1787560364.691457:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560365.714135:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787560365.775514:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787560365.775523:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d982bfc800 from 3 10000000:01000000:2.0:1787560365.775528:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787560365.775568:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 0000000005e2b0bf/0xe34191b05673ed07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560365.775580:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 0000000005e2b0bf/0xe34191b05673ed07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560365.775592:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 0000000005e2b0bf/0xe34191b05673ed07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560365.775612:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b8f6abb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815504768:0@lo:101: 00000100:00100000:2.0:1787560365.775672:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560365.775720:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d6cfd75 going to sleep for 11 seconds 00000100:00100000:1.0:1787560365.775764:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815504768 00000100:00100000:1.0:1787560365.775771:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815504768 00000100:00100000:1.0:1787560365.775825:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787560365.775833:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008787aa5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:5836:x1874392815504768:12345-0@lo:101: 00010000:00010000:1.0:1787560365.775877:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560365.775900:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004da58b28/0xe34191b05673ed0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ed07 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560365.775922:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004da58b28/0xe34191b05673ed0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ed07 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560365.775947:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004da58b28/0xe34191b05673ed0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed07 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560365.775956:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004da58b28, rc 0) 00000100:00100000:1.0:1787560365.775992:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008787aa5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5836:x1874392815504768:12345-0@lo:101: Request processed in 160us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560365.775999:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787560365.776038:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b8f6abb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815504768:0@lo:101: 00010000:00010000:1.0:1787560365.776050:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 0000000005e2b0bf/0xe34191b05673ed07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560365.776058:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 0000000005e2b0bf/0xe34191b05673ed07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560365.776100:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0b62b4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815504896:0@lo:256: 00000100:00100000:1.0:1787560365.776126:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560365.776138:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d450758 going to sleep for 11 seconds 00000100:00100000:1.0:1787560365.776148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815504896 00000100:00100000:1.0:1787560365.776152:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815504896 00000100:00100000:1.0:1787560365.776169:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787560365.776174:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea6b1ab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5836:x1874392815504896:12345-0@lo:256: 20000000:01000000:1.0:1787560365.776185:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560365.776200:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560365.776203:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787560365.776263:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea6b1ab2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5836:x1874392815504896:12345-0@lo:256: Request processed in 88us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560365.776269:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787560365.776298:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0b62b4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815504896:0@lo:256: 10000000:01000000:1.0:1787560365.776332:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560365.776337:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: 0000000005e2b0bf/0xe34191b05673ed07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560365.776344:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: 0000000005e2b0bf/0xe34191b05673ed07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1787560365.872435:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787560366.746003:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560367.762955:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560368.783488:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560369.360750:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008050fc72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815505024:0@lo:400: 00000100:00100000:0.0:1787560369.360823:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560369.360953:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815505024 00000100:00100000:3.0:1787560369.360961:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815505024 00000100:00100000:3.0:1787560369.361005:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560369.361013:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000369828e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:3314:x1874392815505024:12345-0@lo:400: 00000100:00100000:2.0:1787560369.361120:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3fc3fd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815505152:0@lo:400: 00000100:00100000:2.0:1787560369.361151:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560369.361227:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815505152 00000100:00100000:2.0:1787560369.361231:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815505152 00000100:00100000:2.0:1787560369.361258:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560369.361270:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef7f986f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815505152:12345-0@lo:400: 00000100:00100000:2.0:1787560369.361308:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef7f986f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815505152:12345-0@lo:400: Request processed in 39us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560369.361327:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787560369.361364:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c3fc3fd2 x1874392815505152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560369.361380:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3fc3fd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815505152:0@lo:400: 00000100:00100000:3.0:1787560369.361518:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000369828e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:3314:x1874392815505024:12345-0@lo:400: Request processed in 505us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560369.361526:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787560369.361590:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008050fc72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815505024:0@lo:400: 00010000:00010000:1.0:1787560369.817504:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560370.832110:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787560371.303368:0:6317:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2b295310 20000000:00000080:0.0:1787560371.303387:0:6317:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d9b50c8400 uarg=0000000000000000 20000000:01000000:0.0:1787560371.303418:0:6317:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787560371.303424:0:6317:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787560371.303429:0:6317:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787560371.303667:0:6317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787560371.303678:0:6317:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787560371.319482:0:6317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560371.319720:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787560371.319784:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787560371.319897:0:6317:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787560371.319923:0:6317:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787560371.319947:0:6317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.319965:0:6317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006c0494a0/0xe34191b05673ecd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673eccf expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.319972:0:6317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.320008:0:6317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006c0494a0/0xe34191b05673ecd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673eccf expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.320023:0:6317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006c0494a0/0xe34191b05673ecd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673eccf expref: 11 pid: 5833 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560371.320037:0:6317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b46b4f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6317:1874392815505280:0@lo:104: 00000100:00100000:0.0:1787560371.320097:0:6317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560371.320157:0:6317:0:(client.c:2715:ptlrpc_set_wait()) set 0000000026e2edd7 going to sleep for 11 seconds 00000100:00100000:3.0:1787560371.320562:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815505280 00000100:00100000:3.0:1787560371.320577:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815505280 00000100:00100000:3.0:1787560371.320643:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560371.320653:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002aa2ec0e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:6317:x1874392815505280:12345-0@lo:104: 00010000:00010000:3.0:1787560371.320684:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560371.320780:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560371.320786:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002aa2ec0e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:6317:x1874392815505280:12345-0@lo:104: Request processed in 135us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560371.320794:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560371.321273:0:6317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b46b4f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6317:1874392815505280:0@lo:104: 00010000:00010000:0.0:1787560371.321307:0:6317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.321347:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560371.321353:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.321360:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030282ee3 already unused, calling callback (00000000ce196a8e) 10000000:00010000:0.0:1787560371.321362:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.321370:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560371.321385:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560371.321390:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787560371.321433:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.321440:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560371.321453:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.321458:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: 0000000030282ee3/0xe34191b05673eccf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ecd6 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.321473:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560371.321475:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560371.321476:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560371.321719:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3b46b4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815505408:0@lo:103: 00000100:00100000:2.0:1787560371.322018:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560371.324892:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815505408 00000100:00100000:0.0:1787560371.324908:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815505408 00010000:00010000:0.0:1787560371.324952:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006c0494a0/0xe34191b05673ecd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673eccf expref: 12 pid: 5833 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560371.324996:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560371.325006:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3fc3fd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:3312:x1874392815505408:12345-0@lo:103: 00010000:00010000:0.0:1787560371.325021:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560371.325026:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006c0494a0/0xe34191b05673ecd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673eccf expref: 12 pid: 5833 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325038:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006c0494a0/0xe34191b05673ecd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673eccf expref: 12 pid: 5833 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325074:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c0494a0/0xe34191b05673ecd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673eccf expref: 12 pid: 5833 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325094:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325101:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325119:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325126:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325132:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325139:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325145:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001da30f8a already unused, calling callback (00000000a426df81) 00010000:00010000:0.0:1787560371.325148:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325155:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325178:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560371.325201:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560371.325273:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3fc3fd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:3312:x1874392815505408:12345-0@lo:103: Request processed in 269us (3256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560371.325292:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787560371.325463:0:6317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560371.325480:0:6317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560371.325487:0:6317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001da30f8a/0xe34191b05673ed15 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560371.327161:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3b46b4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815505408:0@lo:103: 00010000:00010000:0.0:1787560371.869545:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560372.879723:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787560373.903380:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560373.903388:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d982bfc800 from 1 10000000:01000000:1.0:1787560373.903393:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560373.903436:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: 00000000a55134a5/0xe34191b05673ed1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560373.903449:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: 00000000a55134a5/0xe34191b05673ed1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560373.903460:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: 00000000a55134a5/0xe34191b05673ed1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560373.903481:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0b62b4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815505536:0@lo:101: 00000100:00100000:1.0:1787560373.903557:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560373.903616:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea1902ec going to sleep for 11 seconds 00000100:00100000:3.0:1787560373.903797:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815505536 00000100:00100000:3.0:1787560373.903806:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815505536 00000100:00100000:3.0:1787560373.903877:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787560373.903886:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e941c27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:5836:x1874392815505536:12345-0@lo:101: 00010000:00010000:3.0:1787560373.903898:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560373.903910:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000416b2528/0xe34191b05673ed23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ed1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560373.903931:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000416b2528/0xe34191b05673ed23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ed1c expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560373.903941:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000416b2528/0xe34191b05673ed23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed1c expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560373.903949:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000416b2528, rc 0) 00000100:00100000:3.0:1787560373.904000:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e941c27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5836:x1874392815505536:12345-0@lo:101: Request processed in 115us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560373.904007:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1787560373.904111:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560373.904136:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0b62b4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815505536:0@lo:101: 00010000:00010000:0.0:1787560373.904149:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: 00000000a55134a5/0xe34191b05673ed1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560373.904157:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: 00000000a55134a5/0xe34191b05673ed1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560373.904214:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007bab3421 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815505664:0@lo:501: 00000100:00100000:0.0:1787560373.904251:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560373.904277:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e9dbb47 going to sleep for 11 seconds 00000100:00100000:3.0:1787560373.904365:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815505664 00000100:00100000:3.0:1787560373.904370:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815505664 00000100:00100000:3.0:1787560373.904414:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787560373.904420:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000718c6ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5836:x1874392815505664:12345-0@lo:501: 00000100:00100000:3.0:1787560373.904758:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000718c6ad6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5836:x1874392815505664:12345-0@lo:501: Request processed in 337us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560373.904766:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787560373.904834:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007bab3421 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815505664:0@lo:501: 00000100:00100000:0.0:1787560373.904890:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007bab3421 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815505792:0@lo:503: 00000100:00100000:0.0:1787560373.904928:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560373.904946:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e9dbb47 going to sleep for 11 seconds 00000100:00100000:1.0:1787560373.906718:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815505792 00000100:00100000:1.0:1787560373.906728:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815505792 00000100:00100000:1.0:1787560373.906780:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560373.906788:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000879fc08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5836:x1874392815505792:12345-0@lo:503: 00000100:00100000:1.0:1787560373.906991:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000879fc08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5836:x1874392815505792:12345-0@lo:503: Request processed in 204us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560373.907005:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560373.907195:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007bab3421 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815505792:0@lo:503: 00000100:00100000:0.0:1787560373.910453:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007bab3421 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6466:1874392815505920:0@lo:502: 00000100:00100000:0.0:1787560373.910555:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560373.910614:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7eb3a11 going to sleep for 11 seconds 00000100:00100000:1.0:1787560373.910727:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815505920 00000100:00100000:1.0:1787560373.910735:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815505920 00000100:00100000:1.0:1787560373.910787:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787560373.910795:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd0323df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6466:x1874392815505920:12345-0@lo:502: 00000100:00100000:1.0:1787560373.911022:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd0323df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6466:x1874392815505920:12345-0@lo:502: Request processed in 227us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560373.911030:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560373.913291:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007bab3421 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6466:1874392815505920:0@lo:502: 00000020:01000000:0.0:1787560373.913342:0:6466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560373.913357:0:6466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560373.913360:0:6466:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787560373.913370:0:6466:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d982bfc800 00000020:00000080:0.0:1787560373.913373:0:6466:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787560373.913431:0:6466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6466:1874392815506048:0@lo:502: 00000100:00100000:0.0:1787560373.913516:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560373.913558:0:6466:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98439d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560373.913841:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815506048 00000100:00100000:2.0:1787560373.913882:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815506048 00000100:00100000:2.0:1787560373.913932:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560373.913942:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6466:x1874392815506048:12345-0@lo:502: 00000100:00100000:2.0:1787560373.914126:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6466:x1874392815506048:12345-0@lo:502: Request processed in 185us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560373.914134:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560373.914299:0:6466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6466:1874392815506048:0@lo:502: 00000020:01000000:0.0:1787560373.914319:0:6466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560373.914325:0:6466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560373.914327:0:6466:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787560373.914330:0:6466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787560373.914478:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787560373.914507:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560373.914517:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673ed1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560373.914528:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673ed1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560374.483532:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815506304:0@lo:400: 00000100:00100000:0.0:1787560374.483608:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560374.483681:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560374.483688:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815506176:0@lo:400: 00000100:00100000:0.0:1787560374.483720:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560374.483759:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815506176 00000100:00100000:0.0:1787560374.483767:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815506176 00000100:00100000:0.0:1787560374.483824:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560374.483833:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:3314:x1874392815506176:12345-0@lo:400: 00000100:00100000:0.0:1787560374.483899:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:3314:x1874392815506176:12345-0@lo:400: Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560374.483906:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560374.483953:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815506176:0@lo:400: 00000100:00100000:2.0:1787560374.484517:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815506304 00000100:00100000:2.0:1787560374.484538:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815506304 00000100:00100000:2.0:1787560374.484580:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560374.484587:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815506304:12345-0@lo:400: 00000100:00100000:2.0:1787560374.484639:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815506304:12345-0@lo:400: Request processed in 53us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560374.484646:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787560374.486476:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d9ba33a300 x1874392815506304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560374.486505:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815506304:0@lo:400: 00010000:00010000:1.0:1787560374.936214:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560375.951208:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560376.975062:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787560377.573652:0:6680:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787560377.573657:0:6680:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787560377.573767:0:6680:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d986ace800 00000020:01000004:2.0:1787560377.573783:0:6680:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787560377.573793:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787560377.573806:0:6680:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93d9901e8000) 00000020:00000080:2.0:1787560377.573821:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787560377.606124:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787560377.606715:0:6680:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787560377.642702:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787560377.649422:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787560377.649671:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787560377.649730:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787560377.649758:0:6680:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787560377.652994:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787560377.653010:0:6680:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787560377.653021:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe34191b05673ed31 00000020:01000004:2.0:1787560377.653029:0:6680:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787560377.653053:0:6680:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787560377.653057:0:6680:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787560377.653065:0:6680:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787560377.653070:0:6680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787560377.653083:0:6680:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93d9901e99b8) 00000020:00000080:2.0:1787560377.653094:0:6680:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787560377.660232:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560377.661601:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787560377.661609:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787560377.662354:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787560377.662362:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787560377.663990:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787560377.664003:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787560377.668419:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560377.669511:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787560377.669519:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787560377.674806:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787560377.674815:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787560377.700746:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560377.701049:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787560377.701088:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787560377.703254:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787560377.703267:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787560377.708604:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787560377.708618:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787560377.712920:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560377.713096:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787560377.713102:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787560377.716252:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787560377.716266:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787560377.813806:0:6680:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560377.814051:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787560377.814057:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787560377.819392:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787560377.819411:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787560377.820510:0:6680:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787560377.820541:0:6680:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787560377.820548:0:6680:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787560377.866920:0:6680:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787560377.866967:0:6680:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787560377.866972:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787560377.866973:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560377.866974:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560377.866975:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560377.866977:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560377.866978:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560377.866979:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560377.866981:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560377.866982:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560377.866984:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560377.866985:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560377.866988:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787560377.866990:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560377.866992:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560377.866993:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560377.866994:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560377.866995:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560377.866996:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560377.866997:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560377.866998:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560377.866999:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560377.867000:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560377.867001:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560377.867036:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787560377.867058:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815506432:0@lo:253: 00000100:00100000:2.0:1787560377.867130:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560377.867529:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d990125cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560377.868669:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815506432 00000100:00100000:1.0:1787560377.868682:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815506432 00000100:00100000:1.0:1787560377.868786:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787560377.868796:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815506432:12345-0@lo:253: 20000000:01000000:1.0:1787560377.868828:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787560377.868832:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787560377.868837:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787560377.868841:0:5833:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787560377.871643:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560377.872637:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787560377.872663:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787560377.872719:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787560377.872727:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787560377.872757:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787560377.872816:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787560377.874573:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787560377.874603:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.156@tcp 20000000:01000000:1.0:1787560377.874605:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.156@tcp (null) (null) (null) 00000040:00080000:1.0:1787560377.874645:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787560377.874652:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787560377.874700:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787560377.874707:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.156@tcp (null) (null) 00000040:00080000:1.0:1787560377.874741:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787560377.874750:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787560377.874804:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787560377.874894:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787560377.880096:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787560377.880129:0:5833:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.156@tcp 20000000:01000000:1.0:1787560377.880131:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.156@tcp (null) (null) (null) 00000040:00080000:1.0:1787560377.880178:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787560377.880187:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787560377.880219:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787560377.880227:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.156@tcp (null) (null) 00000040:00080000:1.0:1787560377.880273:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787560377.880283:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787560377.880315:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787560377.880348:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787560377.880365:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787560377.880369:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787560377.880375:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787560377.880376:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787560377.880379:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787560377.880390:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787560377.880392:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787560377.881024:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787560377.881028:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787560377.887723:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787560377.894938:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787560377.894991:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787560377.895065:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787560377.895081:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787560377.895084:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787560377.896185:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787560377.896249:0:6696:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787560377.896318:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787560377.896660:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787560377.896699:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787560377.896755:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787560377.896767:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787560377.896770:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787560377.897818:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787560377.897906:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787560377.897955:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787560377.899134:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787560377.899195:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787560377.899262:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:1.0:1787560377.899490:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787560377.899511:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.899528:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c2045e00/0xe34191b05673ec58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ec51 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.899535:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ec74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ec6d expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.899542:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d980030c00/0xe34191b05673ece4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ecdd expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.899549:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.899586:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d980030c00/0xe34191b05673ece4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ecdd expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.899602:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d980030c00/0xe34191b05673ece4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ecdd expref: 12 pid: 5833 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560377.899616:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874392815506560:0@lo:104: 00000100:00100000:1.0:1787560377.899677:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560377.899881:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ec74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ec6d expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.899889:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ec74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ec6d expref: 12 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560377.899898:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b70000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874392815506688:0@lo:104: 00000100:00100000:1.0:1787560377.899928:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560377.900106:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c2045e00/0xe34191b05673ec58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ec51 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.900116:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9c2045e00/0xe34191b05673ec58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ec51 expref: 12 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560377.900125:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b70380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874392815506816:0@lo:104: 00000100:00100000:1.0:1787560377.900145:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560377.900172:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815506560 00000100:00100000:3.0:1787560377.900180:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815506560 00000100:00100000:2.0:1787560377.900229:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815506688 00000100:00100000:2.0:1787560377.900233:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815506688 00000100:00100000:2.0:1787560377.900257:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560377.900266:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:5833:x1874392815506560:12345-0@lo:104: 00010000:00010000:2.0:1787560377.900290:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673ecdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.900347:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560377.900353:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:5833:x1874392815506560:12345-0@lo:104: Request processed in 88us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.900361:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560377.900383:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560377.900389:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5833:x1874392815506688:12345-0@lo:104: 00010000:00010000:2.0:1787560377.900397:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9829c4400/0xe34191b05673ec6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.900444:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787560377.900449:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5833:x1874392815506688:12345-0@lo:104: Request processed in 61us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.900455:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787560377.900610:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560377.900617:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673ecdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.900625:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da400 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560377.900629:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673ecdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.900637:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673ecdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560377.900644:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673ecdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560377.900651:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560377.900688:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673ecdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.900695:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560377.900713:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673ecdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.900728:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673ecdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ece4 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.900742:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560377.900745:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9829c4400/0xe34191b05673ec6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.900751:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c4400 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560377.900754:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c4400/0xe34191b05673ec6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.900761:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9829c4400/0xe34191b05673ec6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560377.900768:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c4400/0xe34191b05673ec6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560377.900773:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560377.900785:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9829c4400/0xe34191b05673ec6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.900791:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560377.900796:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9829c4400/0xe34191b05673ec6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.900803:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9829c4400/0xe34191b05673ec6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ec74 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.900813:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560377.900819:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560377.900821:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560377.900834:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815506944:0@lo:103: 00000100:00100000:0.0:1787560377.900895:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560377.900916:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560377.900922:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815507072:0@lo:103: 00000100:00100000:0.0:1787560377.900941:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560377.900969:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815506944 00000100:00100000:0.0:1787560377.900973:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815506944 00010000:00010000:0.0:1787560377.900989:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d980030c00/0xe34191b05673ece4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ecdd expref: 13 pid: 5833 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560377.901008:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815507072 00000100:00100000:0.0:1787560377.901011:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815507072 00010000:00010000:0.0:1787560377.901020:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ec74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ec6d expref: 14 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560377.901031:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560377.901037:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:3311:x1874392815506944:12345-0@lo:103: 00010000:00010000:0.0:1787560377.901061:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560377.901067:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d980030c00/0xe34191b05673ece4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ecdd expref: 14 pid: 5833 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.901077:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d980030c00/0xe34191b05673ece4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ecdd expref: 14 pid: 5833 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.901093:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560377.901119:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:3311:x1874392815506944:12345-0@lo:103: Request processed in 82us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560377.901126:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560377.901145:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560377.901151:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:3311:x1874392815507072:12345-0@lo:103: 00010000:00010000:0.0:1787560377.901158:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560377.901175:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ec74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ec6d expref: 13 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.901185:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ec74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ec6d expref: 13 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.901195:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560377.901215:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:3311:x1874392815507072:12345-0@lo:103: Request processed in 64us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560377.901220:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560377.901256:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815507072:0@lo:103: 00000100:00100000:0.0:1787560377.901265:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815506944:0@lo:103: 00010000:00010000:0.0:1787560377.901310:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560377.901581:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba7a0d80 going to sleep for 11 seconds 00010000:00010000:1.0:1787560377.901596:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980030c00/0xe34191b05673ece4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ecdd expref: 12 pid: 5833 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560377.901607:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874392815506560:0@lo:104: 00010000:00010000:1.0:1787560377.901617:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ec74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ec6d expref: 11 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560377.901626:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b70000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874392815506688:0@lo:104: 00000100:00100000:2.0:1787560377.901667:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815506816 00000100:00100000:2.0:1787560377.901671:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815506816 00000100:00100000:2.0:1787560377.901693:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560377.901698:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5833:x1874392815506816:12345-0@lo:104: 00010000:00010000:2.0:1787560377.901707:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ec51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.901756:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560377.901769:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5833:x1874392815506816:12345-0@lo:104: Request processed in 71us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.901775:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560377.901827:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b70380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5833:1874392815506816:0@lo:104: 00010000:00010000:1.0:1787560377.901906:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.901972:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560377.901978:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ec51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.901985:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c5e00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560377.901988:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ec51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.901996:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ec51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560377.902003:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ec51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560377.902018:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560377.902049:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ec51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.902056:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560377.902073:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ec51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.902080:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ec51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ec58 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.902097:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560377.902100:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560377.902102:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560377.902112:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815507200:0@lo:103: 00000100:00100000:0.0:1787560377.902138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560377.902185:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815507200 00000100:00100000:0.0:1787560377.902190:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815507200 00010000:00010000:0.0:1787560377.902205:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c2045e00/0xe34191b05673ec58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ec51 expref: 11 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560377.902222:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560377.902229:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:3313:x1874392815507200:12345-0@lo:103: 00010000:00010000:0.0:1787560377.902236:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560377.902240:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c2045e00/0xe34191b05673ec58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ec51 expref: 11 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.902249:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c2045e00/0xe34191b05673ec58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ec51 expref: 11 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.902267:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c2045e00/0xe34191b05673ec58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ec51 expref: 11 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.902841:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.903005:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.903021:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.903028:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.903035:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.903042:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.903048:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560377.903052:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.903059:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.905617:0:5833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.905633:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787560377.905641:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1787560377.905763:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.905785:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21db400/0xe34191b05673ed3f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.905808:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560377.905912:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+10:3313:x1874392815507200:12345-0@lo:103: Request processed in 3680us (3768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560377.905922:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560377.906017:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815507200:0@lo:103: 00000100:00100000:1.0:1787560377.938176:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+9:6680:x1874392815506432:12345-0@lo:253: Request processed in 69363us (71027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560377.938190:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560377.938299:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815506432:0@lo:253: 10000000:01000000:0.0:1787560377.938315:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787560377.938318:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787560377.938320:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787560377.938321:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560377.938323:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787560377.938324:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560377.938325:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560377.938327:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560377.938329:0:6680:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787560377.938331:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560377.938332:0:6680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787560377.938355:0:6680:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d986ace800 from lustre-OST0000 10000000:01000000:0.0:1787560377.938381:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787560377.938384:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787560377.938391:0:6680:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d9901ecd28 local copy 10000000:01000000:0.0:1787560377.938396:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787560377.938442:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.938452:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.938461:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560377.938494:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815507328:0@lo:101: 00000100:00100000:0.0:1787560377.938530:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560377.938583:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d99048b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560377.938689:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815507328 00000100:00100000:1.0:1787560377.938696:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815507328 00000100:00100000:1.0:1787560377.938738:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787560377.938747:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+9:6680:x1874392815507328:12345-0@lo:101: 00010000:00010000:1.0:1787560377.938760:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560377.938773:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21db800/0xe34191b05673ed4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ed46 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.938797:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21db800/0xe34191b05673ed4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ed46 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.938807:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21db800/0xe34191b05673ed4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed46 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.938816:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db800, rc 0) 00000100:00100000:1.0:1787560377.938874:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+10:6680:x1874392815507328:12345-0@lo:101: Request processed in 127us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560377.938880:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787560377.939007:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815507328:0@lo:101: 00010000:00010000:0.0:1787560377.939020:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.939029:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560377.939138:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815507456:0@lo:501: 00000100:00100000:0.0:1787560377.939175:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560377.939201:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d99048b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560377.939254:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815507456 00000100:00100000:1.0:1787560377.939259:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815507456 00000100:00100000:1.0:1787560377.939286:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560377.939293:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+10:6680:x1874392815507456:12345-0@lo:501: 00000100:00100000:1.0:1787560377.939754:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+10:6680:x1874392815507456:12345-0@lo:501: Request processed in 459us (588us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787560377.939769:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787560377.939886:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815507456:0@lo:501: 10000000:01000000:2.0:1787560377.939902:0:6680:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787560377.939930:0:6680:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787560377.939935:0:6680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.939944:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.939952:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.939969:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787560377.939987:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d986ace800 10000000:01000000:2.0:1787560377.939991:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787560377.939995:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93d9901ecd28 10000000:01000000:2.0:1787560377.939998:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787560377.940001:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93d9901ecd28 from 1 10000000:01000000:2.0:1787560377.940004:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787560377.940024:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c2044a00/0xe34191b05673ed54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.940031:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c2044a00/0xe34191b05673ed54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.940040:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c2044a00/0xe34191b05673ed54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560377.940062:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815507584:0@lo:101: 00000100:00100000:2.0:1787560377.940089:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560377.940108:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9894ad300 going to sleep for 11 seconds 00010000:00010000:1.0:1787560377.940176:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560377.940183:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.940191:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030600 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560377.940195:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.940203:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560377.940211:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560377.940216:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560377.940236:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.940242:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560377.940269:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.940276:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d980030600/0xe34191b05673ed46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe34191b05673ed4d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.940293:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560377.940295:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560377.940297:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560377.940304:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560377.940323:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815507712:0@lo:103: 00000100:00100000:1.0:1787560377.940350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560377.940378:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815507712 00000100:00100000:1.0:1787560377.940383:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815507712 00000100:00100000:1.0:1787560377.940416:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560377.940516:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815507584 00000100:00100000:0.0:1787560377.940522:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815507584 00000100:00100000:0.0:1787560377.940546:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787560377.940553:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:6680:x1874392815507584:12345-0@lo:101: 00010000:00010000:0.0:1787560377.940564:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560377.940576:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d980030200/0xe34191b05673ed5b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ed54 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.940593:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980030200/0xe34191b05673ed5b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ed54 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.940603:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d980030200/0xe34191b05673ed5b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed54 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.940621:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980030200, rc 0) 00000100:00100000:0.0:1787560377.940652:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815507584:12345-0@lo:101: Request processed in 99us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560377.940658:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787560377.940745:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815507584:0@lo:101: 00010000:00010000:2.0:1787560377.940756:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c2044a00/0xe34191b05673ed54 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed5b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.940764:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c2044a00/0xe34191b05673ed54 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ed5b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560377.940779:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787560377.940796:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c2044a00/0xe34191b05673ed54 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed5b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.940803:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c2044a00/0xe34191b05673ed54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed5b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560377.940810:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787560377.940814:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560377.940818:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787560377.940820:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787560377.940833:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.940840:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.940871:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560377.940889:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815507840:0@lo:101: 00000100:00100000:2.0:1787560377.940915:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560377.940930:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9894ad300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560377.940990:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815507840 00000100:00100000:0.0:1787560377.940994:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815507840 00000100:00100000:0.0:1787560377.941022:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787560377.941028:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815507840:12345-0@lo:101: 00010000:00010000:0.0:1787560377.941035:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560377.941042:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d980031600/0xe34191b05673ed69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ed62 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.941053:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980031600/0xe34191b05673ed69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ed62 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.941060:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d980031600/0xe34191b05673ed69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed62 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560377.941066:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980031600, rc 0) 00000100:00100000:0.0:1787560377.941090:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815507840:12345-0@lo:101: Request processed in 63us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560377.941095:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787560377.941188:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:3313:x1874392815507712:12345-0@lo:103: 00010000:00010000:1.0:1787560377.941198:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560377.941209:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21db800/0xe34191b05673ed4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673ed46 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.941219:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560377.941249:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:3313:x1874392815507712:12345-0@lo:103: Request processed in 65us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560377.941255:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560377.941283:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815507712:0@lo:103: 00000100:00100000:2.0:1787560377.941349:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815507840:0@lo:101: 00010000:00010000:2.0:1787560377.941358:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.941366:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560377.941616:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815507968:0@lo:501: 00000100:00100000:2.0:1787560377.941643:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560377.941661:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9894ad300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560377.941712:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815507968 00000100:00100000:0.0:1787560377.941717:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815507968 00000100:00100000:0.0:1787560377.941746:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787560377.941752:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:6680:x1874392815507968:12345-0@lo:501: 00000100:00100000:0.0:1787560377.942035:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:6680:x1874392815507968:12345-0@lo:501: Request processed in 281us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560377.942049:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560377.942190:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815507968:0@lo:501: 00000100:00100000:2.0:1787560377.942216:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508096:0@lo:503: 00000100:00100000:2.0:1787560377.942251:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560377.942316:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9894ad300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560377.942346:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815508096 00000100:00100000:0.0:1787560377.942351:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815508096 00000100:00100000:0.0:1787560377.942410:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787560377.942418:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:6680:x1874392815508096:12345-0@lo:503: 00000100:00100000:0.0:1787560377.942575:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:6680:x1874392815508096:12345-0@lo:503: Request processed in 157us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560377.942582:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787560377.942655:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508096:0@lo:503: 00000040:00080000:3.0:1787560377.942935:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560377.943009:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4226a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508224:0@lo:502: 00000100:00100000:3.0:1787560377.943043:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560377.943339:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98739b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560377.943388:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815508224 00000100:00100000:2.0:1787560377.943394:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815508224 00000100:00100000:2.0:1787560377.943429:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787560377.943436:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:6680:x1874392815508224:12345-0@lo:502: 00000100:00100000:2.0:1787560377.943587:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:6680:x1874392815508224:12345-0@lo:502: Request processed in 150us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.943594:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560377.943712:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4226a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508224:0@lo:502: 00000040:00080000:3.0:1787560377.943986:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787560377.944034:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787560377.944068:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787560377.944111:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787560377.944147:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787560377.944193:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787560377.944227:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4226a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508352:0@lo:502: 00000100:00100000:3.0:1787560377.944265:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560377.944284:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98739b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560377.944372:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815508352 00000100:00100000:2.0:1787560377.944382:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815508352 00000100:00100000:2.0:1787560377.944405:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787560377.944412:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:6680:x1874392815508352:12345-0@lo:502: 00000100:00100000:2.0:1787560377.944667:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:6680:x1874392815508352:12345-0@lo:502: Request processed in 254us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.944674:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787560377.944756:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4226a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508352:0@lo:502: 00000040:00080000:3.0:1787560377.944839:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787560377.944878:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787560377.945597:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787560377.945608:0:6698:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787560377.945614:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560377.945616:0:6698:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787560377.945621:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787560377.945635:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93d9901819b8) 00000020:00000080:3.0:1787560377.945657:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787560377.945662:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787560377.945733:0:6698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d986ace800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787560377.945740:0:6698:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787560377.945746:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe34191b05673ed77 00010000:00010000:0.0:1787560377.950623:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787560377.951091:0:6698:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787560377.953593:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787560377.953955:0:6698:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787560377.959935:0:6698:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787560377.960636:0:6698:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787560377.961932:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787560377.961943:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560377.961948:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560377.961951:0:6698:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787560377.961955:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560377.961959:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560377.961960:0:6698:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787560377.961963:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787560377.961965:0:6698:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787560377.962010:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560377.962013:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560377.962014:0:6698:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787560377.962017:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787560377.962173:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787560377.962199:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787560377.962243:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.962256:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560377.962264:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d986ace800 from 1 10000000:01000000:1.0:1787560377.962266:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560377.962301:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.962309:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.962334:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560377.962362:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508480:0@lo:101: 00000100:00100000:1.0:1787560377.962438:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560377.962476:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d8811c8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560377.962600:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815508480 00000100:00100000:2.0:1787560377.962608:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815508480 00000100:00100000:2.0:1787560377.962654:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787560377.962663:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:6680:x1874392815508480:12345-0@lo:101: 00010000:00010000:2.0:1787560377.962677:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560377.962689:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c2044400/0xe34191b05673ed85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ed7e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.962711:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c2044400/0xe34191b05673ed85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ed7e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.962720:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c2044400/0xe34191b05673ed85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed7e expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.962736:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2044400, rc 0) 00000100:00100000:2.0:1787560377.962776:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815508480:12345-0@lo:101: Request processed in 114us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.962782:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787560377.962893:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508480:0@lo:101: 00010000:00010000:1.0:1787560377.962907:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.962915:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560377.963001:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508608:0@lo:501: 00000100:00100000:1.0:1787560377.963026:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560377.963046:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d8811c8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560377.963105:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815508608 00000100:00100000:2.0:1787560377.963110:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815508608 00000100:00100000:2.0:1787560377.963138:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787560377.963145:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815508608:12345-0@lo:501: 00000100:00100000:2.0:1787560377.965781:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815508608:12345-0@lo:501: Request processed in 2628us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.965794:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787560377.969768:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508608:0@lo:501: 00000100:00100000:1.0:1787560377.969824:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508736:0@lo:503: 00000100:00100000:1.0:1787560377.969990:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560377.970074:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d8811c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560377.972585:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815508736 00000100:00100000:0.0:1787560377.972598:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815508736 00000100:00100000:0.0:1787560377.972686:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560377.972697:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815508736:12345-0@lo:503: 00000100:00100000:0.0:1787560377.973120:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815508736:12345-0@lo:503: Request processed in 424us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560377.973128:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560377.973237:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508736:0@lo:503: 00000040:00080000:2.0:1787560377.973633:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560377.973710:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508864:0@lo:502: 00000100:00100000:2.0:1787560377.973761:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560377.973953:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9894add80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560377.974019:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815508864 00000100:00100000:1.0:1787560377.974025:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815508864 00000100:00100000:1.0:1787560377.974053:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787560377.974060:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815508864:12345-0@lo:502: 00000100:00100000:1.0:1787560377.974261:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815508864:12345-0@lo:502: Request processed in 200us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560377.974275:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560377.974359:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508864:0@lo:502: 00000040:00080000:2.0:1787560377.974672:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787560377.974732:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787560377.974758:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508992:0@lo:502: 00000100:00100000:2.0:1787560377.974797:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560377.974891:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9894add80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560377.974980:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815508992 00000100:00100000:0.0:1787560377.974985:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815508992 00000100:00100000:3.0:1787560377.975031:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787560377.975042:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815508992:12345-0@lo:502: 00000100:00100000:3.0:1787560377.975234:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815508992:12345-0@lo:502: Request processed in 194us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560377.975241:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560377.975395:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815508992:0@lo:502: 00000040:00080000:2.0:1787560377.975546:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787560377.975562:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787560377.976497:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560377.976507:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560377.976509:0:6702:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787560377.976516:0:6702:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d986ace800 00000020:00000080:1.0:1787560377.976518:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560377.976540:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560377.976543:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560377.976545:0:6702:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787560377.976548:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787560377.976685:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787560377.976706:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560377.976761:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.976773:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560377.976811:0:6680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787560377.976814:0:6680:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d986ace800 10000000:01000000:2.0:1787560377.976817:0:6680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d986ace800 10000000:01000000:2.0:1787560377.976821:0:6680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560377.976826:0:6680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d986ace800 from 1 10000000:01000000:2.0:1787560377.976829:0:6680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560377.976907:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.976916:0:6680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560377.976927:0:6680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560377.976945:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815509120:0@lo:101: 00000100:00100000:2.0:1787560377.976998:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560377.977031:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9894ad900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560377.977086:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815509120 00000100:00100000:1.0:1787560377.977093:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815509120 00000100:00100000:1.0:1787560377.977133:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787560377.977142:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815509120:12345-0@lo:101: 00010000:00010000:1.0:1787560377.977153:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560377.977177:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21da800/0xe34191b05673ed93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ed8c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.977199:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21da800/0xe34191b05673ed93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ed8c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.977208:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21da800/0xe34191b05673ed93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed8c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560377.977217:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21da800, rc 0) 00000100:00100000:1.0:1787560377.977261:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815509120:12345-0@lo:101: Request processed in 120us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560377.977267:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787560377.977387:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815509120:0@lo:101: 00010000:00010000:3.0:1787560377.977402:0:6680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560377.977410:0:6680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560377.977521:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4226a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815509248:0@lo:501: 00000100:00100000:3.0:1787560377.977547:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560377.977575:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98739b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560377.977671:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815509248 00000100:00100000:2.0:1787560377.977676:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815509248 00000100:00100000:2.0:1787560377.977706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787560377.977713:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815509248:12345-0@lo:501: 00000100:00100000:2.0:1787560377.977946:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815509248:12345-0@lo:501: Request processed in 232us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.977953:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787560377.978059:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4226a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815509248:0@lo:501: 00000100:00100000:3.0:1787560377.978087:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4226a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815509376:0@lo:503: 00000100:00100000:3.0:1787560377.978125:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560377.978150:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98739b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560377.978205:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815509376 00000100:00100000:2.0:1787560377.978210:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815509376 00000100:00100000:2.0:1787560377.978239:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787560377.978247:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815509376:12345-0@lo:503: 00000100:00100000:2.0:1787560377.978385:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815509376:12345-0@lo:503: Request processed in 138us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.978391:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787560377.978508:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4226a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815509376:0@lo:503: 00000040:00080000:1.0:1787560377.978781:0:6680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560377.978830:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815509504:0@lo:502: 00000100:00100000:1.0:1787560377.978889:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560377.978908:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d8811c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560377.978968:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815509504 00000100:00100000:2.0:1787560377.978973:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815509504 00000100:00100000:2.0:1787560377.979004:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787560377.979011:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815509504:12345-0@lo:502: 00000100:00100000:2.0:1787560377.979151:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815509504:12345-0@lo:502: Request processed in 140us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.979158:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787560377.979241:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815509504:0@lo:502: 00000040:00080000:1.0:1787560377.979488:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787560377.979532:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787560377.979563:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787560377.979603:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787560377.979634:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787560377.979678:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787560377.979712:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787560377.979742:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787560377.979788:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787560377.979823:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787560377.979892:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787560377.979940:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787560377.979977:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787560377.980010:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787560377.980075:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787560377.980113:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787560377.980147:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787560377.980217:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787560377.980255:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787560377.980287:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787560377.980332:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787560377.980370:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787560377.980402:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787560377.980459:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787560377.980494:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787560377.980539:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787560377.980588:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787560377.980623:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787560377.980659:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815509632:0@lo:502: 00000100:00100000:1.0:1787560377.980714:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560377.980742:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d8811c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560377.982150:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815509632 00000100:00100000:2.0:1787560377.982174:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815509632 00000100:00100000:2.0:1787560377.982253:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787560377.982264:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815509632:12345-0@lo:502: 00000100:00100000:2.0:1787560377.982516:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815509632:12345-0@lo:502: Request processed in 254us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560377.982524:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787560377.982825:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815509632:0@lo:502: 00000040:00080000:1.0:1787560377.983123:0:6680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787560377.983138:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787560377.983766:0:6703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787560377.983790:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93d8812acd28) 00000020:00000080:2.0:1787560377.983808:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787560377.983911:0:6703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d986ace800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787560377.983915:0:6703:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d986ace800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787560377.983917:0:6703:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d986ace800 3 00010000:00080000:2.0:1787560377.983941:0:6703:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d881253000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.156@tcp at head 00010000:00010000:2.0:1787560377.990333:0:6703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787560377.992824:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787560377.993573:0:6703:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787560377.993589:0:6703:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe34191b05673eda1 00000100:00080000:2.0:1787560377.993601:0:6703:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560377.993606:0:6703:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d881253000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1787560377.993643:0:6703:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9ba33b800 x1874392815509760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560377.993679:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874392815509760:0@lo:38: 00000100:00100000:2.0:1787560377.993746:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560377.993809:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815509760 00000100:00100000:2.0:1787560377.993815:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815509760 00000100:00100000:2.0:1787560377.993843:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787560377.994904:0:6703:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787560377.994986:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874392815509760:12345-0@lo:38: 00010000:00080000:2.0:1787560377.995026:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1787560377.995067:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe34191b05673eda8 00000004:00100000:2.0:1787560377.995082:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787560377.995113:0:5837:0:(import.c:65:import_set_state_nolock()) ffff93d991f49000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560377.995379:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815509888:0@lo:400: 00000100:00100000:0.0:1787560377.995413:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560377.995480:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787560377.995490:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787560377.995662:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815509888 00000100:00100000:0.0:1787560377.995670:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815509888 00000100:00100000:0.0:1787560377.995698:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787560377.995706:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560377.995712:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815509888:12345-0@lo:400: 00000100:00100000:0.0:1787560377.995752:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815509888:12345-0@lo:400: Request processed in 40us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560377.995759:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787560377.995793:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d98641c700 x1874392815509888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560377.995806:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815509888:0@lo:400: 00000100:00100000:2.0:1787560378.002013:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba33bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874392815509760:12345-0@lo:38: Request processed in 7021us (8257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560378.002027:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1787560378.002238:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787560378.002508:0:6680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787560378.002542:0:6680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787560378.002566:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560378.002578:0:6680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787560378.002628:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787560378.002631:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787560378.002632:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560378.002633:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560378.002634:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560378.002635:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560378.002637:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560378.002638:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560378.002639:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560378.002641:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560378.002642:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787560378.002646:0:6680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787560378.002648:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787560378.002649:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787560378.002650:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560378.002651:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560378.002657:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560378.002658:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560378.002659:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560378.002660:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560378.002661:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560378.002662:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560378.002663:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787560378.002687:0:6680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787560378.002706:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815510016:0@lo:253: 00000100:00100000:1.0:1787560378.002764:0:6680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560378.002794:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d8811c8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560378.002993:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815510016 00000100:00100000:2.0:1787560378.003001:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815510016 00000100:00100000:2.0:1787560378.003042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787560378.003049:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6680:x1874392815510016:12345-0@lo:253: 20000000:01000000:2.0:1787560378.003072:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787560378.003084:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787560378.003473:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d9ba33b800 x1874392815509760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560378.003483:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560378.003493:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787560378.003499:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787560378.003504:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787560378.003507:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d881253000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787560378.003514:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874392815509760:0@lo:38: 00010000:00010000:3.0:1787560378.003579:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1787560378.026615:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787560378.026635:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787560378.026687:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787560378.026692:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787560378.026715:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560378.026734:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c21dbc00/0xe34191b05673ed0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed07 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560378.026742:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560378.026783:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c21dbc00/0xe34191b05673ed0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ed07 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560378.026797:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9c21dbc00/0xe34191b05673ed0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ed07 expref: 13 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560378.026812:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874392815510144:0@lo:104: 00000100:00100000:0.0:1787560378.026909:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560378.026971:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9989f6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560378.027062:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815510144 00000100:00100000:2.0:1787560378.027070:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815510144 00000100:00100000:2.0:1787560378.027119:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560378.027130:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5853:x1874392815510144:12345-0@lo:104: 00010000:00010000:2.0:1787560378.027144:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673ed07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027206:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560378.027212:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5853:x1874392815510144:12345-0@lo:104: Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560378.027219:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560378.027258:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874392815510144:0@lo:104: 00010000:00010000:2.0:1787560378.027276:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027390:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560378.027396:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673ed07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027404:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044e00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560378.027408:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673ed07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027494:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673ed07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560378.027501:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673ed07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560378.027506:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560378.027577:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673ed07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027584:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560378.027601:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673ed07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027608:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673ed07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed0e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027625:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560378.027626:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560378.027628:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560378.027640:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815510272:0@lo:103: 00000100:00100000:2.0:1787560378.027674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560378.027716:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815510272 00000100:00100000:2.0:1787560378.027721:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815510272 00010000:00010000:2.0:1787560378.027737:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c21dbc00/0xe34191b05673ed0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ed07 expref: 14 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560378.027760:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560378.027767:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e12450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:3312:x1874392815510272:12345-0@lo:103: 00010000:00010000:2.0:1787560378.027783:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560378.027789:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c21dbc00/0xe34191b05673ed0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ed07 expref: 14 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027798:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c21dbc00/0xe34191b05673ed0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ed07 expref: 14 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027810:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21dbc00/0xe34191b05673ed0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ed07 expref: 14 pid: 5832 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027823:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027830:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787560378.027842:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008357731s 00010000:00010000:2.0:1787560378.027866:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027874:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027881:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027887:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027892:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560378.027895:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027909:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027922:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.027931:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560378.027959:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e12450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:3312:x1874392815510272:12345-0@lo:103: Request processed in 193us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560378.027966:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787560378.028010:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.028017:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560378.028022:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980030400/0xe34191b05673edaf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560378.028046:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815510272:0@lo:103: 00000100:00100000:2.0:1787560378.043114:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:6680:x1874392815510016:12345-0@lo:253: Request processed in 40056us (40340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560378.043128:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787560378.043782:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6680:1874392815510016:0@lo:253: 10000000:01000000:1.0:1787560378.043798:0:6680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787560378.043801:0:6680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787560378.043803:0:6680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787560378.043804:0:6680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560378.043805:0:6680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560378.043807:0:6680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560378.043808:0:6680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560378.043809:0:6680:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560378.043810:0:6680:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560378.043811:0:6680:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560378.043813:0:6680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560378.043815:0:6680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787560378.043829:0:6680:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787560378.050647:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560378.050818:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787560378.051049:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560378.051249:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787560378.051449:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560378.051666:0:6680:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787560378.058705:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787560378.250475:0:6680:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787560378.250482:0:6680:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787560378.250512:0:6680:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787560378.250568:0:6680:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787560378.250584:0:6680:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787560378.250609:0:6680:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787560379.022976:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560380.050172:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560381.073138:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787560381.135775:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787560381.135782:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d982bfc800 from 21 10000000:01000000:2.0:1787560381.135787:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560381.135829:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.135890:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.135903:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560381.135935:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815510400:0@lo:101: 00000100:00100000:2.0:1787560381.135999:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.136041:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560381.137466:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815510400 00000100:00100000:1.0:1787560381.137477:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815510400 00000100:00100000:1.0:1787560381.137538:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787560381.137549:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5836:x1874392815510400:12345-0@lo:101: 00010000:00010000:1.0:1787560381.137564:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560381.137578:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21db200/0xe34191b05673edbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673edb6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560381.137603:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21db200/0xe34191b05673edbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673edb6 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560381.137613:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21db200/0xe34191b05673edbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673edb6 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560381.137623:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db200, rc 0) 00000100:00100000:1.0:1787560381.137686:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815510400:12345-0@lo:101: Request processed in 139us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560381.137692:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560381.137784:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815510400:0@lo:101: 00010000:00010000:2.0:1787560381.137802:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.137811:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560381.137884:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815510528:0@lo:501: 00000100:00100000:2.0:1787560381.137914:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.137941:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560381.138035:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815510528 00000100:00100000:0.0:1787560381.138040:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815510528 00000100:00100000:0.0:1787560381.138075:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787560381.138082:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815510528:12345-0@lo:501: 00000100:00100000:0.0:1787560381.138327:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815510528:12345-0@lo:501: Request processed in 245us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560381.138334:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787560381.138376:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815510528:0@lo:501: 00000100:00100000:2.0:1787560381.138401:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815510656:0@lo:503: 00000100:00100000:2.0:1787560381.138447:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.138467:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560381.139006:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815510656 00000100:00100000:1.0:1787560381.139011:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815510656 00000100:00100000:1.0:1787560381.139037:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787560381.139044:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815510656:12345-0@lo:503: 00000100:00100000:1.0:1787560381.139265:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815510656:12345-0@lo:503: Request processed in 221us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560381.139273:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787560381.139366:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815510656:0@lo:503: 00000100:00100000:2.0:1787560381.141243:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6852:1874392815510784:0@lo:502: 00000100:00100000:2.0:1787560381.141317:0:6852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.141356:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560381.141454:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815510784 00000100:00100000:0.0:1787560381.141462:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815510784 00000100:00100000:0.0:1787560381.141506:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787560381.141516:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6852:x1874392815510784:12345-0@lo:502: 00000100:00100000:0.0:1787560381.141778:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6852:x1874392815510784:12345-0@lo:502: Request processed in 262us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560381.141785:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787560381.141803:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6852:1874392815510784:0@lo:502: 00000100:00100000:2.0:1787560381.141951:0:6852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6852:1874392815510912:0@lo:502: 00000100:00100000:2.0:1787560381.141984:0:6852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.142001:0:6852:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560381.142011:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815510912 00000100:00100000:1.0:1787560381.142015:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815510912 00000100:00100000:1.0:1787560381.142044:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787560381.142052:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6852:x1874392815510912:12345-0@lo:502: 00000100:00100000:1.0:1787560381.142209:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:6852:x1874392815510912:12345-0@lo:502: Request processed in 158us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560381.142221:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787560381.142250:0:6852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6852:1874392815510912:0@lo:502: 00000040:00080000:2.0:1787560381.142269:0:6852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787560381.142534:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787560381.142552:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787560381.142561:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560381.142572:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560381.142581:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560381.142583:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d982bfc800 from 4 10000000:01000000:1.0:1787560381.142586:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560381.142611:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560381.142618:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560381.142628:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560381.142639:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815511040:0@lo:101: 00000100:00100000:1.0:1787560381.142663:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560381.142678:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560381.147436:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815511040 00000100:00100000:0.0:1787560381.147451:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815511040 00000100:00100000:0.0:1787560381.147513:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787560381.147524:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815511040:12345-0@lo:101: 00010000:00010000:0.0:1787560381.147541:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560381.147559:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d980030c00/0xe34191b05673edcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673edc4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560381.147605:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980030c00/0xe34191b05673edcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673edc4 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560381.147616:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d980030c00/0xe34191b05673edcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673edc4 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560381.147624:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980030c00, rc 0) 00000100:00100000:0.0:1787560381.147708:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815511040:12345-0@lo:101: Request processed in 186us (5044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560381.147715:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787560381.159045:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815511040:0@lo:101: 00010000:00010000:3.0:1787560381.159075:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560381.159088:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560381.159227:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4226300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815511168:0@lo:256: 00000100:00100000:3.0:1787560381.159286:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560381.159327:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba7a0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560381.160238:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815511168 00000100:00100000:1.0:1787560381.160247:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815511168 00000100:00100000:1.0:1787560381.160306:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787560381.160316:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815511168:12345-0@lo:256: 20000000:01000000:1.0:1787560381.160339:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560381.160434:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560381.160438:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787560381.160541:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815511168:12345-0@lo:256: Request processed in 226us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560381.160549:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787560381.161005:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4226300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815511168:0@lo:256: 10000000:01000000:3.0:1787560381.161054:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787560381.161060:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560381.161070:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560381.161078:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787560381.161081:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787560381.161083:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787560381.161117:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560381.161125:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560381.161133:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560381.161147:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4226300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815511296:0@lo:101: 00000100:00100000:3.0:1787560381.161178:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560381.161210:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba7a0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560381.172080:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815511296 00000100:00100000:1.0:1787560381.172094:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815511296 00000100:00100000:1.0:1787560381.172152:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787560381.172161:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815511296:12345-0@lo:101: 00010000:00010000:1.0:1787560381.172176:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560381.172192:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21db400/0xe34191b05673edd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673edd2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560381.172218:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21db400/0xe34191b05673edd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673edd2 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560381.172229:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21db400/0xe34191b05673edd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673edd2 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560381.172238:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db400, rc 0) 00000100:00100000:1.0:1787560381.172305:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815511296:12345-0@lo:101: Request processed in 145us (11127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560381.172313:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787560381.173121:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4226300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815511296:0@lo:101: 00010000:00010000:3.0:1787560381.173147:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560381.173157:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560381.173219:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4226300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815511424:0@lo:501: 00000100:00100000:3.0:1787560381.173256:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560381.173294:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba7a0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560381.173355:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815511424 00000100:00100000:1.0:1787560381.173360:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815511424 00000100:00100000:1.0:1787560381.173403:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787560381.173411:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815511424:12345-0@lo:501: 00000100:00100000:1.0:1787560381.173655:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815511424:12345-0@lo:501: Request processed in 244us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560381.173671:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560381.174860:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4226300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815511424:0@lo:501: 00000100:00100000:2.0:1787560381.174914:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815511552:0@lo:503: 00000100:00100000:2.0:1787560381.174968:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.175000:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560381.175018:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815511552 00000100:00100000:2.0:1787560381.175023:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815511552 00000100:00100000:2.0:1787560381.175068:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560381.175077:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815511552:12345-0@lo:503: 00000100:00100000:2.0:1787560381.175317:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815511552:12345-0@lo:503: Request processed in 240us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560381.175324:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560381.175366:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815511552:0@lo:503: 00000100:00100000:2.0:1787560381.175538:0:6855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6855:1874392815511680:0@lo:502: 00000100:00100000:2.0:1787560381.175570:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.175582:0:6855:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7a540 going to sleep for 11 seconds 00000100:00100000:3.0:1787560381.179555:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815511680 00000100:00100000:3.0:1787560381.179571:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815511680 00000100:00100000:3.0:1787560381.179628:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787560381.179639:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:6855:x1874392815511680:12345-0@lo:502: 00000100:00100000:3.0:1787560381.180000:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:6855:x1874392815511680:12345-0@lo:502: Request processed in 362us (4427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560381.180008:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787560381.180171:0:6855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6855:1874392815511680:0@lo:502: 00000020:01000000:2.0:1787560381.180216:0:6855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787560381.180224:0:6855:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787560381.180231:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560381.180233:0:6855:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787560381.180241:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787560381.180244:0:6855:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.156@tcp to nid 0x20000c0a8c99c (192.168.201.156@tcp) 00000020:01000000:2.0:1787560381.180266:0:6855:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787560381.180269:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560381.180295:0:6855:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93d8812a8000) 00000020:00000080:2.0:1787560381.180314:0:6855:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787560381.180320:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787560381.180397:0:6855:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787560381.180403:0:6855:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787560381.180420:0:6855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ede7 00010000:00080000:2.0:1787560381.180449:0:6855:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d986ac9800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.156@tcp at head 00010000:00010000:2.0:1787560381.180671:0:6855:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787560381.272659:0:6855:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787560381.272681:0:6855:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787560381.277333:0:6855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560381.278765:0:6855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560381.278819:0:6855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787560381.278918:0:6855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787560381.287145:0:6859:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787560381.287152:0:6859:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787560381.287747:0:6855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787560381.287761:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787560381.287796:0:6855:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787560381.287818:0:6855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe34191b05673edee 00000100:00080000:2.0:1787560381.287829:0:6855:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560381.287835:0:6855:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d986ac9800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1787560381.288654:0:6855:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9ba338000 x1874392815511808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560381.288681:0:6855:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787560381.288762:0:6855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560381.288768:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560381.288770:0:6855:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787560381.288773:0:6855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560381.288777:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560381.288778:0:6855:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787560381.288781:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787560381.288783:0:6855:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787560381.288811:0:6855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6855:1874392815511936:0@lo:502: 00000100:00100000:1.0:1787560381.289933:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815511808:0@lo:8: 00000100:00100000:1.0:1787560381.290009:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.290240:0:6855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.290264:0:6855:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98725e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560381.290343:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815511936 00000100:00100000:2.0:1787560381.290351:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815511936 00000100:00100000:2.0:1787560381.290609:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787560381.290618:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:6855:x1874392815511936:12345-0@lo:502: 00000100:00100000:1.0:1787560381.290977:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815512064:0@lo:400: 00000100:00100000:1.0:1787560381.291014:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560381.291045:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560381.291051:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815512192:0@lo:400: 00000100:00100000:1.0:1787560381.291076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560381.291132:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815512064 00000100:00100000:1.0:1787560381.291136:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815512064 00000100:00100000:1.0:1787560381.291163:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815512192 00000100:00100000:1.0:1787560381.291166:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815512192 00000100:00100000:1.0:1787560381.291196:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560381.291203:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815512064:12345-0@lo:400: 00000100:00100000:1.0:1787560381.291245:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815512064:12345-0@lo:400: Request processed in 43us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560381.291252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560381.291268:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560381.291274:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815512192:12345-0@lo:400: 00000100:00100000:1.0:1787560381.291300:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815512192:12345-0@lo:400: Request processed in 26us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560381.291305:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787560381.291337:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9ba338380 x1874392815512192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560381.291349:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815512192:0@lo:400: 00010000:00080000:1.0:1787560381.292187:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9ba33b480 x1874392815512064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560381.292214:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815512064:0@lo:400: 00000100:00100000:3.0:1787560381.292334:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815511808 00000100:00100000:3.0:1787560381.292342:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815511808 00000100:00100000:3.0:1787560381.292442:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560381.292449:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874392815511808:12345-0@lo:8: 00010000:00080000:3.0:1787560381.292474:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1787560381.292503:0:6683:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe34191b05673edf5 00002000:00100000:3.0:1787560381.292544:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93d9ad961000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787560381.292549:0:6683:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787560381.292553:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787560381.292665:0:6683:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787560381.292799:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787560381.292826:0:6683:0:(import.c:65:import_set_state_nolock()) ffff93d9ad960800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560381.293249:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874392815511808:12345-0@lo:8: Request processed in 796us (3239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560381.293257:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787560381.293287:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787560381.293331:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9ba338000 x1874392815511808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560381.293341:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560381.293348:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787560381.293355:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787560381.293371:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787560381.293374:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d986ac9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787560381.293388:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787560381.293392:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815511808:0@lo:8: 00000004:00080000:3.0:1787560381.319053:0:6859:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787560381.319353:0:6859:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 210072505130ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787560381.325149:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:6855:x1874392815511936:12345-0@lo:502: Request processed in 34523us (34900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560381.325163:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787560381.325257:0:6855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:6855:1874392815511936:0@lo:502: 00000020:01000000:2.0:1787560381.325292:0:6855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560381.325299:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560381.325301:0:6855:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787560381.325307:0:6855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787560381.325487:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787560381.325509:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787560381.325519:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.325537:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560381.325546:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787560381.325549:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d9901ecd28 from 1 10000000:01000000:2.0:1787560381.325552:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787560381.325580:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.325588:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.325597:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560381.325612:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815512320:0@lo:101: 00000100:00100000:2.0:1787560381.325646:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.325680:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98725e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560381.325696:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815512320 00000100:00100000:2.0:1787560381.325703:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815512320 00000100:00100000:2.0:1787560381.325737:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560381.325746:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815512320:12345-0@lo:101: 00010000:00010000:2.0:1787560381.325756:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560381.325782:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4462400/0xe34191b05673ee03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673edfc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.325806:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4462400/0xe34191b05673ee03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673edfc expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.325824:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4462400/0xe34191b05673ee03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673edfc expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.325831:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4462400, rc 0) 00000100:00100000:2.0:1787560381.326046:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815512320:12345-0@lo:101: Request processed in 300us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560381.326052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560381.326100:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815512320:0@lo:101: 00010000:00010000:2.0:1787560381.326125:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.326134:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560381.326176:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815512448:0@lo:501: 00000100:00100000:2.0:1787560381.326199:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.326216:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98725e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560381.326227:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815512448 00000100:00100000:2.0:1787560381.326231:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815512448 00000100:00100000:2.0:1787560381.326252:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787560381.326258:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815512448:12345-0@lo:501: 00000100:00100000:2.0:1787560381.326551:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815512448:12345-0@lo:501: Request processed in 291us (349us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560381.326558:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787560381.326586:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815512448:0@lo:501: 10000000:01000000:2.0:1787560381.326606:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787560381.326616:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560381.326624:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560381.344679:0:6860:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787560381.344710:0:6860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6860:1874392815512704:0@lo:7: 00000100:00100000:2.0:1787560381.344784:0:6860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.344826:0:6860:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9884fde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560381.346016:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815512576:0@lo:13: 00000100:00100000:2.0:1787560381.346061:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560381.346447:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815512704 00000100:00100000:2.0:1787560381.346455:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815512704 00000100:00100000:2.0:1787560381.346558:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560381.346570:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6860:x1874392815512704:12345-0@lo:7: 00000100:00100000:0.0:1787560381.349013:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815512576 00000100:00100000:0.0:1787560381.349027:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815512576 00000100:00100000:0.0:1787560381.349069:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560381.349078:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874392815512576:12345-0@lo:13: 00002000:00000024:0.0:1787560381.349120:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787560381.349196:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874392815512576:12345-0@lo:13: Request processed in 118us (3134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560381.349202:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787560381.355990:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787560381.363192:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787560381.363200:0:6685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787560381.363346:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6860:x1874392815512704:12345-0@lo:7: Request processed in 16773us (18557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560381.363356:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787560381.363443:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9ba339880 x1874392815512576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560381.363468:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815512576:0@lo:13: 00010000:00080000:0.0:1787560381.370522:0:6860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9ba338700 x1874392815512704/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787560397 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560381.370542:0:6860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6860:1874392815512704:0@lo:7: 00000004:00080000:0.0:1787560381.370557:0:6860:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787560381.370658:0:6860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b70a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6860:1874392815512832:0@lo:5: 00000100:00100000:1.0:1787560381.370719:0:6860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560381.370769:0:6860:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560381.372010:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815512832 00000100:00100000:0.0:1787560381.372020:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815512832 00000100:00100000:0.0:1787560381.372065:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560381.372074:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6860:x1874392815512832:12345-0@lo:5: 00002000:00080000:0.0:1787560381.372118:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787560381.372122:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787560381.372773:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6860:x1874392815512832:12345-0@lo:5: Request processed in 698us (2052us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787560381.372782:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787560381.372827:0:6860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d998b70a80 x1874392815512832/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560397 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560381.372843:0:6860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b70a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6860:1874392815512832:0@lo:5: 00000004:00080000:0.0:1787560381.372873:0:6860:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787560381.373962:0:6860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6860:1874392815512960:0@lo:700: 00000100:00100000:0.0:1787560381.374015:0:6860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560381.374037:0:6860:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787560381.374062:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815512960 00000100:00100000:0.0:1787560381.374068:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815512960 00000100:00100000:0.0:1787560381.374101:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560381.374121:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6860:x1874392815512960:12345-0@lo:700: 00000100:00100000:0.0:1787560381.374153:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1874392815513088:0@lo:700: 00000100:00100000:0.0:1787560381.374179:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560381.374195:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560381.374349:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815513088 00000100:00100000:3.0:1787560381.374354:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815513088 00000100:00100000:3.0:1787560381.374485:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560381.374494:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1874392815513088:12345-0@lo:700: 00000004:00080000:3.0:1787560381.404657:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1787560381.470014:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1787560381.477656:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6691:x1874392815513088:12345-0@lo:700: Request processed in 103157us (103468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560381.477668:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787560381.477736:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98641ce00 x1874392815513088/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787560397 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560381.477751:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6691:1874392815513088:0@lo:700: 40000000:02000000:0.0:1787560381.477763:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1787560381.526063:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1787560381.526252:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:6860:x1874392815512960:12345-0@lo:700: Request processed in 152128us (152232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560381.526280:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:1.0:1787560381.526360:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1787560381.526492:0:6860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98641f100 x1874392815512960/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787560397 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560381.526506:0:6860:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787560381.526532:0:6860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6860:1874392815512960:0@lo:700: 00000004:02000040:3.0:1787560381.546355:0:6860:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787560381.550779:0:6860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6860:1874392815513216:0@lo:5: 00000100:00100000:0.0:1787560381.551031:0:6860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560381.551090:0:6860:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560381.551163:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815513216 00000100:00100000:3.0:1787560381.551181:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815513216 00000100:00100000:3.0:1787560381.551240:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560381.551250:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6860:x1874392815513216:12345-0@lo:5: 00002000:00080000:3.0:1787560381.555924:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787560381.555946:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787560381.559182:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6860:x1874392815513216:12345-0@lo:5: Request processed in 7927us (8146us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787560381.559195:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787560381.559422:0:6860:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98641ce00 x1874392815513216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560397 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560381.559442:0:6860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6860:1874392815513216:0@lo:5: 00000004:00080000:0.0:1787560381.559459:0:6860:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787560382.095118:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560383.131204:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560384.147699:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560385.168774:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787560385.721311:0:7051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787560386.191230:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560386.768642:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815513344:0@lo:400: 00000100:00100000:1.0:1787560386.768713:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560386.768766:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560386.768774:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815513728:0@lo:400: 00000100:00100000:1.0:1787560386.768800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560386.768831:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815513472:0@lo:400: 00000100:00100000:1.0:1787560386.768907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560386.768925:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560386.768930:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815513600:0@lo:400: 00000100:00100000:1.0:1787560386.768951:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560386.768990:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815513344 00000100:00100000:1.0:1787560386.768998:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815513344 00000100:00100000:1.0:1787560386.769055:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787560386.769064:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3312:x1874392815513344:12345-0@lo:400: 00000100:00100000:1.0:1787560386.769111:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3312:x1874392815513344:12345-0@lo:400: Request processed in 48us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560386.769131:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787560386.769167:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815513728 00000100:00100000:1.0:1787560386.769171:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815513728 00000100:00100000:1.0:1787560386.769204:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560386.769210:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874392815513728:12345-0@lo:400: 00000100:00100000:1.0:1787560386.769240:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874392815513728:12345-0@lo:400: Request processed in 31us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560386.769246:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560386.769283:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815513472 00000100:00100000:1.0:1787560386.769287:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815513472 00000100:00100000:1.0:1787560386.769317:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815513600 00000100:00100000:1.0:1787560386.769321:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815513600 00000100:00100000:1.0:1787560386.769343:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560386.769349:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815513472:12345-0@lo:400: 00000100:00080000:0.0:1787560386.771119:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560386.771127:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560386.771150:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560386.771163:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815513600:12345-0@lo:400: 00000100:00100000:1.0:1787560386.771701:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815513472:12345-0@lo:400: Request processed in 2350us (2791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560386.771710:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560386.771747:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560386.771760:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815513856:0@lo:13: 00000100:00100000:1.0:1787560386.771795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560386.771834:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815513856 00000100:00100000:1.0:1787560386.771841:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815513856 00000100:00100000:1.0:1787560386.771895:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560386.771901:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874392815513856:12345-0@lo:13: 00002000:00000024:1.0:1787560386.771930:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560386.771967:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874392815513856:12345-0@lo:13: Request processed in 66us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560386.771983:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787560386.772030:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98641f100 x1874392815513856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560386.772049:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815513856:0@lo:13: 00010000:00080000:2.0:1787560386.772750:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d998b70a80 x1874392815513472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560386.772771:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815513472:0@lo:400: 00010000:00080000:0.0:1787560386.776723:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d998b71180 x1874392815513728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560386.776741:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815513728:0@lo:400: 00000100:00100000:0.0:1787560386.776753:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815513344:0@lo:400: 00000100:00100000:0.0:1787560386.776902:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815513600:12345-0@lo:400: Request processed in 5743us (7949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560386.776912:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787560386.776956:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d998b73800 x1874392815513600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560386.776967:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815513600:0@lo:400: 00000001:00080000:1.0:1787560386.994479:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787560387.222089:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560388.239145:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560389.263584:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560390.293048:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560391.311431:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560391.896803:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874392815514368:0@lo:400: 00000100:00100000:2.0:1787560391.896895:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560391.896978:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815514368 00000100:00100000:2.0:1787560391.896985:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815514368 00000100:00100000:2.0:1787560391.897040:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560391.897049:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874392815514368:12345-0@lo:400: 00000100:00100000:2.0:1787560391.897101:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874392815514368:12345-0@lo:400: Request processed in 52us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560391.897108:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787560391.897128:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560391.897146:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815514240:0@lo:400: 00000100:00100000:2.0:1787560391.897172:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560391.898842:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815514240 00000100:00100000:2.0:1787560391.898867:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815514240 00000100:00100000:2.0:1787560391.898909:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560391.898931:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815514240:12345-0@lo:400: 00000100:00100000:2.0:1787560391.898987:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815514240:12345-0@lo:400: Request processed in 71us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560391.899009:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560391.901680:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815513984:0@lo:13: 00000100:00100000:1.0:1787560391.901759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560391.901790:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815514496:0@lo:400: 00000100:00100000:1.0:1787560391.901813:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560391.901842:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560391.901865:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815514112:0@lo:400: 00000100:00100000:1.0:1787560391.901895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560391.901956:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815513984 00000100:00100000:1.0:1787560391.901963:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815513984 00000100:00100000:1.0:1787560391.902020:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560391.902029:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815513984:12345-0@lo:13: 00002000:00000024:1.0:1787560391.902065:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560391.902109:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815513984:12345-0@lo:13: Request processed in 81us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560391.902116:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560391.902139:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815514496 00000100:00100000:1.0:1787560391.902142:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815514496 00000100:00100000:1.0:1787560391.902166:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560391.902172:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815514496:12345-0@lo:400: 00000100:00100000:1.0:1787560391.902211:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815514496:12345-0@lo:400: Request processed in 40us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560391.902242:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787560391.902781:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98641c000 x1874392815513984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560391.902793:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787560391.902815:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815513984:0@lo:13: 00010000:00080000:1.0:1787560391.902824:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9ba33b480 x1874392815514496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560391.902832:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815514496:0@lo:400: 00010000:00080000:2.0:1787560391.904463:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9ba338000 x1874392815514368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560391.904493:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874392815514368:0@lo:400: 00000100:00100000:2.0:1787560391.904581:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815514112 00000100:00100000:2.0:1787560391.904589:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815514112 00000100:00100000:2.0:1787560391.905802:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560391.905814:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3313:x1874392815514112:12345-0@lo:400: 00000100:00100000:2.0:1787560391.907588:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3313:x1874392815514112:12345-0@lo:400: Request processed in 1767us (5682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560391.907709:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560391.907824:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815514112:0@lo:400: 00010000:00080000:1.0:1787560391.919883:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9ba338700 x1874392815514240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560391.919904:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815514240:0@lo:400: 00000100:00080000:3.0:1787560391.928761:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560392.343696:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560393.363087:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560394.385380:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560395.410086:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560396.435015:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560397.017278:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560397.017305:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815514624:0@lo:13: 00000100:00100000:0.0:1787560397.017373:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560397.017435:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815514624 00000100:00100000:0.0:1787560397.017443:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815514624 00000100:00100000:0.0:1787560397.017495:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560397.017505:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815514624:12345-0@lo:13: 00002000:00000024:0.0:1787560397.017538:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560397.017579:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815514624:12345-0@lo:13: Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560397.017587:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787560397.017610:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560397.017638:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98641f480 x1874392815514624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560397.017656:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815514624:0@lo:13: 00000100:00100000:1.0:1787560397.018047:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815514880:0@lo:400: 00000100:00100000:1.0:1787560397.018082:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560397.018101:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560397.018105:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815514752:0@lo:400: 00000100:00100000:1.0:1787560397.018129:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560397.018155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815514880 00000100:00100000:1.0:1787560397.018159:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815514880 00000100:00100000:1.0:1787560397.018186:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560397.018192:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815514880:12345-0@lo:400: 00000100:00100000:1.0:1787560397.018224:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815514880:12345-0@lo:400: Request processed in 32us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560397.018238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560397.018256:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815514752 00000100:00100000:1.0:1787560397.018259:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815514752 00000100:00100000:1.0:1787560397.018283:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787560397.018289:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3312:x1874392815514752:12345-0@lo:400: 00000100:00100000:1.0:1787560397.018317:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3312:x1874392815514752:12345-0@lo:400: Request processed in 29us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560397.018323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787560397.018349:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560397.018356:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815515008:0@lo:400: 00000100:00100000:1.0:1787560397.018391:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560397.018417:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815515008 00000100:00100000:1.0:1787560397.018420:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815515008 00000100:00100000:1.0:1787560397.018449:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560397.018455:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815515008:12345-0@lo:400: 00000100:00100000:1.0:1787560397.018486:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815515008:12345-0@lo:400: Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560397.018492:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787560397.018506:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787560397.018522:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d998b71180 x1874392815515008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560397.018533:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815515008:0@lo:400: 00000100:00100000:1.0:1787560397.018555:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815514752:0@lo:400: 00010000:00080000:1.0:1787560397.018564:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d998b71880 x1874392815514880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560397.018583:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815514880:0@lo:400: 00010000:00010000:3.0:1787560397.457412:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560398.487495:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560399.511950:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560400.533497:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560401.553659:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787560401.591531:0:7623:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787560401.591538:0:7623:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787560401.592824:0:7623:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d9bfc6d000 00000020:01000004:3.0:1787560401.592887:0:7623:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787560401.592904:0:7623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787560401.592942:0:7623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93d9894fb370) 00000020:00000080:3.0:1787560401.592968:0:7623:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787560401.631680:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787560401.632429:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787560401.663040:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787560401.675940:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787560401.676068:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787560401.676269:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787560401.676299:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787560401.676740:0:7623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787560401.678346:0:7623:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787560401.678366:0:7623:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe34191b05673ee11 00000020:01000004:2.0:1787560401.678378:0:7623:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787560401.678410:0:7623:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787560401.678414:0:7623:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787560401.678423:0:7623:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787560401.678465:0:7623:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787560401.678471:0:7623:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787560401.711817:0:7623:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787560401.711976:0:7623:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.156@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787560401.711981:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787560401.711983:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787560401.711984:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560401.711986:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560401.711987:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560401.711989:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560401.711990:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560401.711992:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560401.711993:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560401.711995:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560401.711997:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787560401.712002:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787560401.712079:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787560401.712081:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787560401.712082:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560401.712083:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560401.712084:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560401.712085:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560401.712086:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560401.712088:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560401.712089:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560401.712090:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560401.712091:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787560401.712128:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787560401.712153:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815515136:0@lo:253: 00000100:00100000:1.0:1787560401.712687:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560401.712822:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560401.712935:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815515136 00000100:00100000:2.0:1787560401.712946:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815515136 00000100:00100000:2.0:1787560401.713060:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787560401.713072:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:7623:x1874392815515136:12345-0@lo:253: 20000000:01000000:2.0:1787560401.713116:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787560401.713121:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787560401.713128:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787560401.713132:0:5831:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787560401.714429:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560401.714677:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787560401.714696:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787560401.714740:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787560401.714763:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787560401.714799:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787560401.714894:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787560401.715322:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787560401.715346:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.156@tcp 20000000:01000000:2.0:1787560401.715348:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.156@tcp (null) (null) (null) 00000040:00080000:2.0:1787560401.715385:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787560401.715394:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787560401.715445:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787560401.715453:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.156@tcp (null) (null) 00000040:00080000:2.0:1787560401.715487:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787560401.715506:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787560401.715545:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787560401.715602:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787560401.717633:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787560401.717674:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.156@tcp 20000000:01000000:2.0:1787560401.717677:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.156@tcp (null) (null) (null) 00000040:00080000:2.0:1787560401.717722:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787560401.717731:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787560401.717781:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787560401.717790:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.156@tcp (null) (null) 00000040:00080000:2.0:1787560401.717824:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787560401.717834:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787560401.718424:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787560401.718535:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787560401.718562:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1787560401.718566:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1787560401.718574:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787560401.718576:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787560401.718579:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787560401.718595:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787560401.718598:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787560401.718648:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787560401.718651:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787560401.719913:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787560401.720148:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787560401.720319:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787560401.730610:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787560401.730767:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787560401.730878:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787560401.730910:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787560401.730914:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787560401.733982:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787560401.734120:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787560401.734427:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787560401.735609:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787560401.735661:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787560401.735782:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787560401.735801:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787560401.735804:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787560401.740393:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787560401.741047:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787560401.741105:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787560401.741209:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787560401.741228:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787560401.741231:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787560401.743799:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787560401.743943:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787560401.744013:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787560401.744830:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787560401.744910:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787560401.744950:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:1.0:1787560401.744974:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787560401.745013:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.745037:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d980031600/0xe34191b05673ed69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed62 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.746934:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c21da800/0xe34191b05673ed93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed8c expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.746947:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c21db200/0xe34191b05673edbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673edb6 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.746954:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c21db400/0xe34191b05673edd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673edd2 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.746980:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4462400/0xe34191b05673ee03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673edfc expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.746990:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.747553:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4462400/0xe34191b05673ee03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673edfc expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.747574:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9b4462400/0xe34191b05673ee03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673edfc expref: 16 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560401.747593:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874392815515264:0@lo:104: 00000100:00100000:1.0:1787560401.747693:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560401.747775:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c21db400/0xe34191b05673edd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673edd2 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.747783:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9c21db400/0xe34191b05673edd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673edd2 expref: 16 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560401.747791:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874392815515392:0@lo:104: 00010000:00010000:1.0:1787560401.747816:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c21db200/0xe34191b05673edbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673edb6 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.747823:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9c21db200/0xe34191b05673edbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673edb6 expref: 16 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560401.747830:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874392815515520:0@lo:104: 00010000:00010000:1.0:1787560401.747885:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c21da800/0xe34191b05673ed93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ed8c expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.747916:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9c21da800/0xe34191b05673ed93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ed8c expref: 16 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560401.747925:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874392815515648:0@lo:104: 00010000:00010000:1.0:1787560401.747977:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d980031600/0xe34191b05673ed69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ed62 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.747985:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d980031600/0xe34191b05673ed69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ed62 expref: 16 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560401.747993:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874392815515776:0@lo:104: 00000100:00100000:0.0:1787560401.752701:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787560401.752784:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.752881:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.752898:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.752916:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815515264 00000100:00100000:0.0:1787560401.752928:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815515264 00000100:00100000:0.0:1787560401.752984:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815515392 00000100:00100000:0.0:1787560401.752988:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815515392 00000100:00100000:0.0:1787560401.752999:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815515520 00000100:00100000:0.0:1787560401.753002:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815515520 00000100:00100000:0.0:1787560401.753012:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815515648 00000100:00100000:0.0:1787560401.753031:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815515648 00000100:00100000:0.0:1787560401.753067:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560401.753079:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99044a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+6:5831:x1874392815515264:12345-0@lo:104: 00010000:00010000:0.0:1787560401.753104:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.753617:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787560401.753626:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99044a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+6:5831:x1874392815515264:12345-0@lo:104: Request processed in 549us (5933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.753635:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560401.753686:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560401.753693:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:5831:x1874392815515392:12345-0@lo:104: 00010000:00010000:0.0:1787560401.753703:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.753742:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787560401.753761:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:5831:x1874392815515392:12345-0@lo:104: Request processed in 69us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.753768:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560401.753782:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560401.753789:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:5831:x1874392815515520:12345-0@lo:104: 00010000:00010000:0.0:1787560401.753796:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.753825:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787560401.753830:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:5831:x1874392815515520:12345-0@lo:104: Request processed in 42us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.753837:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560401.753887:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560401.753894:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5831:x1874392815515648:12345-0@lo:104: 00010000:00010000:0.0:1787560401.753902:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.753932:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787560401.753937:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5831:x1874392815515648:12345-0@lo:104: Request processed in 45us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.753943:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787560401.753967:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787560401.753974:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.753982:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044c00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560401.753987:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.753997:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560401.754005:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560401.754012:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560401.754055:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.754063:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560401.754088:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.754108:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c2044c00/0xe34191b05673edfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee03 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.754125:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787560401.754129:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.754136:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c5200 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560401.754139:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.754147:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560401.754154:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560401.754159:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787560401.754608:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560401.754657:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.754686:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874392815515264:0@lo:104: 00000100:00100000:1.0:1787560401.754697:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874392815515392:0@lo:104: 00000100:00100000:1.0:1787560401.754704:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874392815515520:0@lo:104: 00000100:00100000:1.0:1787560401.754712:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874392815515648:0@lo:104: 00000100:00100000:1.0:1787560401.754939:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815515904:0@lo:103: 00000100:00100000:1.0:1787560401.754978:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560401.755026:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1787560401.757396:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815515776 00000100:00100000:3.0:1787560401.757415:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815515776 00000100:00100000:3.0:1787560401.757496:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560401.757509:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5831:x1874392815515776:12345-0@lo:104: 00010000:00010000:3.0:1787560401.757531:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560401.757644:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787560401.757651:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5831:x1874392815515776:12345-0@lo:104: Request processed in 145us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560401.757677:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560401.757733:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1874392815515776:0@lo:104: 00010000:00010000:3.0:1787560401.757788:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.758860:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.758873:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560401.758902:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.758910:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9829c5200/0xe34191b05673edd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673edd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560401.758948:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815516032:0@lo:103: 00000100:00100000:0.0:1787560401.759056:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.759142:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815515904 00000100:00100000:0.0:1787560401.759150:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815515904 00000100:00100000:2.0:1787560401.759391:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815516032 00000100:00100000:2.0:1787560401.759396:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815516032 00010000:00010000:2.0:1787560401.759422:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c21db400/0xe34191b05673edd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673edd2 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560401.759465:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560401.759483:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:3311:x1874392815516032:12345-0@lo:103: 00010000:00010000:2.0:1787560401.759499:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560401.759506:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c21db400/0xe34191b05673edd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673edd2 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.759518:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c21db400/0xe34191b05673edd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673edd2 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.759540:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21db400/0xe34191b05673edd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673edd2 expref: 18 pid: 5833 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.759558:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560401.759604:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:3311:x1874392815516032:12345-0@lo:103: Request processed in 124us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560401.759611:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560401.759774:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815516032:0@lo:103: 00010000:00010000:1.0:1787560401.763981:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560401.764000:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.764016:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044600 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560401.764022:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.764059:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560401.764066:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560401.764071:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560401.764149:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.764157:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560401.764200:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.764208:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c2044600/0xe34191b05673ed8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed93 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.764226:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560401.764229:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.764235:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2045e00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560401.764238:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.764245:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560401.764251:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560401.764264:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560401.764280:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.764286:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560401.764309:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.764315:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c2045e00/0xe34191b05673ed62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed69 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560401.764359:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815516288:0@lo:103: 00010000:00010000:0.0:1787560401.764885:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4462400/0xe34191b05673ee03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673edfc expref: 16 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560401.764936:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560401.764953:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3314:x1874392815515904:12345-0@lo:103: 00010000:00010000:0.0:1787560401.764969:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560401.764974:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4462400/0xe34191b05673ee03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673edfc expref: 16 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.764987:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4462400/0xe34191b05673ee03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673edfc expref: 16 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.765004:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4462400/0xe34191b05673ee03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673edfc expref: 16 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.765024:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560401.765162:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560401.765176:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815516160:0@lo:103: 00000100:00100000:1.0:1787560401.766376:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560401.766457:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787560401.766470:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787560401.769945:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560401.769953:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560401.769956:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560401.770028:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560401.770039:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560401.770065:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044e00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:3.0:1787560401.770070:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560401.770083:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560401.770099:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560401.770106:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560401.770184:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560401.770192:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560401.770209:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560401.770235:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c2044e00/0xe34191b05673edb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673edbd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560401.770258:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560401.770260:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560401.770261:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560401.770283:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815516416:0@lo:103: 00000100:00100000:0.0:1787560401.770643:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:3314:x1874392815515904:12345-0@lo:103: Request processed in 5693us (15659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.770656:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560401.770701:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815516288 00000100:00100000:0.0:1787560401.770711:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815516288 00010000:00010000:0.0:1787560401.770756:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d980031600/0xe34191b05673ed69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ed62 expref: 15 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560401.770782:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560401.770792:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:3313:x1874392815516288:12345-0@lo:103: 00010000:00010000:0.0:1787560401.770807:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560401.770823:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d980031600/0xe34191b05673ed69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ed62 expref: 15 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.770835:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d980031600/0xe34191b05673ed69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ed62 expref: 15 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.770870:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980031600/0xe34191b05673ed69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ed62 expref: 15 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.770890:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560401.770926:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:3313:x1874392815516288:12345-0@lo:103: Request processed in 136us (4555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.770933:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787560401.777906:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560401.777920:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560401.782544:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815516288:0@lo:103: 00000100:00100000:2.0:1787560401.783413:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.784573:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815516160 00000100:00100000:0.0:1787560401.784588:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815516160 00010000:00010000:0.0:1787560401.784642:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c21da800/0xe34191b05673ed93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ed8c expref: 14 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560401.784690:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560401.784701:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:3311:x1874392815516160:12345-0@lo:103: 00010000:00010000:0.0:1787560401.784719:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560401.784726:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c21da800/0xe34191b05673ed93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ed8c expref: 14 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.784739:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c21da800/0xe34191b05673ed93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ed8c expref: 14 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.784772:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21da800/0xe34191b05673ed93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ed8c expref: 14 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.784817:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560401.784910:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:3311:x1874392815516160:12345-0@lo:103: Request processed in 210us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.784918:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560401.785178:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815516160:0@lo:103: 00000100:00100000:3.0:1787560401.787308:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.787420:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815516416 00000100:00100000:0.0:1787560401.787432:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815516416 00010000:00010000:0.0:1787560401.787489:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c21db200/0xe34191b05673edbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673edb6 expref: 13 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560401.787537:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560401.787546:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:3314:x1874392815516416:12345-0@lo:103: 00010000:00010000:0.0:1787560401.787563:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560401.787569:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c21db200/0xe34191b05673edbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673edb6 expref: 13 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787584:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c21db200/0xe34191b05673edbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673edb6 expref: 13 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787604:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21db200/0xe34191b05673edbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673edb6 expref: 13 pid: 5831 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787624:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787632:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787652:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787683:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787692:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787700:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787707:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560401.787712:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787722:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787758:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.787771:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560401.787961:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.787970:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.787976:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21da600/0xe34191b05673ee18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787560401.788017:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787560401.792454:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:3314:x1874392815516416:12345-0@lo:103: Request processed in 4883us (5128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.792473:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560401.803979:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815516416:0@lo:103: 00000100:00100000:3.0:1787560401.804001:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815515904:0@lo:103: 00000100:00100000:1.0:1787560401.897577:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:7623:x1874392815515136:12345-0@lo:253: Request processed in 184497us (184882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.897593:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787560401.897842:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815515136:0@lo:253: 10000000:01000000:0.0:1787560401.897876:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787560401.897879:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787560401.897881:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787560401.897883:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560401.897884:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787560401.897885:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560401.897898:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560401.897899:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560401.897901:0:7623:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787560401.897902:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560401.897903:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787560401.897935:0:7623:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d9bfc6d000 from lustre-OST0001 10000000:01000000:0.0:1787560401.897976:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787560401.897979:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787560401.897987:0:7623:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d9901ecd28 local copy 10000000:01000000:0.0:1787560401.897991:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787560401.898038:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.898049:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.898057:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560401.898073:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815516544:0@lo:101: 00000100:00100000:0.0:1787560401.898110:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.898206:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b396b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.899110:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815516544 00000100:00100000:1.0:1787560401.899120:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815516544 00000100:00100000:1.0:1787560401.899208:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787560401.899218:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+11:7623:x1874392815516544:12345-0@lo:101: 00010000:00010000:1.0:1787560401.899234:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560401.899250:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ee1f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.899274:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ee1f expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.899299:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee1f expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.899308:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21dac00, rc 0) 00000100:00100000:1.0:1787560401.899367:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815516544:12345-0@lo:101: Request processed in 150us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.899374:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787560401.899449:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815516544:0@lo:101: 00010000:00010000:2.0:1787560401.899464:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.899473:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560401.899573:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815516672:0@lo:501: 00000100:00100000:2.0:1787560401.899604:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560401.899705:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988637a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560401.899928:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815516672 00000100:00100000:0.0:1787560401.899933:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815516672 00000100:00100000:0.0:1787560401.899954:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787560401.899960:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815516672:12345-0@lo:501: 00000100:00100000:0.0:1787560401.900316:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815516672:12345-0@lo:501: Request processed in 353us (709us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560401.900324:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787560401.900411:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815516672:0@lo:501: 10000000:01000000:2.0:1787560401.900425:0:7623:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787560401.900453:0:7623:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787560401.900459:0:7623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.900469:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.900476:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.900501:0:7623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787560401.900522:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d9bfc6d000 10000000:01000000:2.0:1787560401.900527:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787560401.900532:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787560401.900543:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560401.900547:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787560401.900550:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787560401.900569:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.900577:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.900586:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560401.900599:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815516800:0@lo:101: 00000100:00100000:2.0:1787560401.900628:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560401.900647:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9886373c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787560401.900878:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560401.900885:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.900902:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980031600 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560401.900906:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.900924:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560401.900931:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560401.900937:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560401.900955:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.900961:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787560401.901015:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815516928:0@lo:103: 00000100:00100000:2.0:1787560401.901044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560401.901088:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.901096:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe34191b05673ee26 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.901109:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560401.901111:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560401.901112:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560401.901126:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815516800 00000100:00100000:0.0:1787560401.901130:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815516800 00000100:00100000:0.0:1787560401.901152:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787560401.901158:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815516800:12345-0@lo:101: 00010000:00010000:0.0:1787560401.901166:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560401.901181:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d980031a00/0xe34191b05673ee34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ee2d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.901196:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980031a00/0xe34191b05673ee34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ee2d expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.901204:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d980031a00/0xe34191b05673ee34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee2d expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.901211:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980031a00, rc 0) 00000100:00100000:0.0:1787560401.901238:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815516800:12345-0@lo:101: Request processed in 80us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.901245:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787560401.902147:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815516928 00000100:00100000:2.0:1787560401.902155:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815516928 00000100:00100000:2.0:1787560401.902231:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560401.902240:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:3311:x1874392815516928:12345-0@lo:103: 00010000:00010000:2.0:1787560401.902250:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560401.902264:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673ee1f expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.902276:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560401.902327:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:3311:x1874392815516928:12345-0@lo:103: Request processed in 88us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560401.902333:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560401.902401:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815516928:0@lo:103: 00000100:00100000:2.0:1787560401.902479:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815516800:0@lo:101: 00010000:00010000:2.0:1787560401.902494:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.902505:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560401.902595:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517056:0@lo:501: 00000100:00100000:2.0:1787560401.902622:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560401.902693:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9886373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560401.906935:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815517056 00000100:00100000:0.0:1787560401.906950:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815517056 00000100:00100000:1.0:1787560401.907230:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787560401.907242:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815517056:12345-0@lo:501: 00000100:00100000:1.0:1787560401.907566:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815517056:12345-0@lo:501: Request processed in 326us (4942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.907574:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787560401.907661:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517056:0@lo:501: 00000100:00100000:3.0:1787560401.907717:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517184:0@lo:503: 00000100:00100000:3.0:1787560401.907772:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560401.910242:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560401.910412:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815517184 00000100:00100000:2.0:1787560401.910421:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815517184 00000100:00100000:2.0:1787560401.910462:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787560401.910472:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815517184:12345-0@lo:503: 00000100:00100000:2.0:1787560401.910820:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815517184:12345-0@lo:503: Request processed in 349us (3047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560401.910828:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787560401.910950:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517184:0@lo:503: 00000040:00080000:3.0:1787560401.911394:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560401.911479:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517312:0@lo:502: 00000100:00100000:3.0:1787560401.911529:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560401.911568:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560401.911641:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815517312 00000100:00100000:2.0:1787560401.911647:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815517312 00000100:00100000:2.0:1787560401.911669:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787560401.911825:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815517312:12345-0@lo:502: 00000100:00100000:2.0:1787560401.912136:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815517312:12345-0@lo:502: Request processed in 459us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560401.912145:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787560401.912233:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517312:0@lo:502: 00000040:00080000:3.0:1787560401.912666:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787560401.913341:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787560401.913391:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787560401.913467:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787560401.913507:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787560401.913551:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787560401.913589:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517440:0@lo:502: 00000100:00100000:2.0:1787560401.913645:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560401.913901:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988637f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.915178:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815517440 00000100:00100000:1.0:1787560401.915189:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815517440 00000100:00100000:1.0:1787560401.915284:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787560401.915295:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815517440:12345-0@lo:502: 00000100:00100000:1.0:1787560401.915526:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815517440:12345-0@lo:502: Request processed in 233us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.915533:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787560401.915628:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517440:0@lo:502: 00000040:00080000:2.0:1787560401.915805:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787560401.915818:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787560401.916559:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787560401.916566:0:7633:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787560401.916571:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560401.916573:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787560401.916577:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560401.916588:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93d8812a99b8) 00000020:00000080:2.0:1787560401.916606:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787560401.916612:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787560401.916665:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d9bfc6d000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787560401.916979:0:7633:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787560401.916988:0:7633:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe34191b05673ee42 00010000:00010000:3.0:1787560401.921273:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787560401.921572:0:7633:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787560401.926923:0:7633:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787560401.927332:0:7633:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787560401.931630:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787560401.935291:0:7633:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787560401.937204:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787560401.937216:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560401.937223:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560401.937225:0:7633:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787560401.937229:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560401.937233:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560401.937234:0:7633:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787560401.937237:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787560401.937239:0:7633:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787560401.937289:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560401.937293:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560401.937294:0:7633:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787560401.937297:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787560401.937464:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787560401.937490:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787560401.937514:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.937527:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560401.937536:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9bfc6d000 from 1 10000000:01000000:0.0:1787560401.937539:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560401.937575:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.937583:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.937606:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560401.937631:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517568:0@lo:101: 00000100:00100000:0.0:1787560401.937710:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.937763:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b396bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.937891:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815517568 00000100:00100000:1.0:1787560401.937899:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815517568 00000100:00100000:1.0:1787560401.937955:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787560401.937966:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:7623:x1874392815517568:12345-0@lo:101: 00010000:00010000:1.0:1787560401.937978:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560401.937997:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ee49 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.938030:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ee49 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.938040:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee49 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.938049:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21dac00, rc 0) 00000100:00100000:1.0:1787560401.938092:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815517568:12345-0@lo:101: Request processed in 127us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.938099:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787560401.938146:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517568:0@lo:101: 00010000:00010000:1.0:1787560401.938159:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.938169:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560401.938251:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517696:0@lo:501: 00000100:00100000:1.0:1787560401.938275:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560401.938295:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98439d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.938308:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815517696 00000100:00100000:1.0:1787560401.938312:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815517696 00000100:00100000:1.0:1787560401.938331:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787560401.938337:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815517696:12345-0@lo:501: 00000100:00100000:1.0:1787560401.938554:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815517696:12345-0@lo:501: Request processed in 215us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.938569:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787560401.938603:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517696:0@lo:501: 00000100:00100000:1.0:1787560401.938628:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517824:0@lo:503: 00000100:00100000:1.0:1787560401.938665:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560401.938679:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998bbcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.938707:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815517824 00000100:00100000:1.0:1787560401.938710:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815517824 00000100:00100000:1.0:1787560401.938728:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787560401.938734:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815517824:12345-0@lo:503: 00000100:00100000:1.0:1787560401.939062:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815517824:12345-0@lo:503: Request processed in 327us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.939069:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787560401.939108:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517824:0@lo:503: 00000040:00080000:1.0:1787560401.939351:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560401.939404:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517952:0@lo:502: 00000100:00100000:1.0:1787560401.939438:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560401.939453:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998bbcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.939468:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815517952 00000100:00100000:1.0:1787560401.939472:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815517952 00000100:00100000:1.0:1787560401.939489:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787560401.939495:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815517952:12345-0@lo:502: 00000100:00100000:1.0:1787560401.939634:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815517952:12345-0@lo:502: Request processed in 138us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.939641:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787560401.939679:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815517952:0@lo:502: 00000040:00080000:1.0:1787560401.939957:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787560401.940003:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787560401.940023:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518080:0@lo:502: 00000100:00100000:1.0:1787560401.940054:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560401.940068:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bad2d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.940081:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815518080 00000100:00100000:1.0:1787560401.940085:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815518080 00000100:00100000:1.0:1787560401.940103:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787560401.940108:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815518080:12345-0@lo:502: 00000100:00100000:1.0:1787560401.940219:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815518080:12345-0@lo:502: Request processed in 110us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.940226:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787560401.940262:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518080:0@lo:502: 00000040:00080000:1.0:1787560401.940329:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787560401.940337:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787560401.950074:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560401.950094:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560401.950097:0:7636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787560401.950105:0:7636:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d9bfc6d000 00000020:00000080:2.0:1787560401.950108:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787560401.950131:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560401.950135:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560401.950136:0:7636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787560401.950140:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787560401.950791:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787560401.950816:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560401.950833:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.952377:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560401.952447:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787560401.952450:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d9bfc6d000 10000000:01000000:1.0:1787560401.952453:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d9bfc6d000 10000000:01000000:1.0:1787560401.952456:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787560401.952462:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d9bfc6d000 from 1 10000000:01000000:1.0:1787560401.952472:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787560401.952514:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.952523:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560401.952535:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560401.952558:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518208:0@lo:101: 00000100:00100000:1.0:1787560401.952619:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560401.952777:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bad2d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787560401.952827:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815518208 00000100:00100000:3.0:1787560401.952835:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815518208 00000100:00100000:3.0:1787560401.953125:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787560401.953137:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815518208:12345-0@lo:101: 00010000:00010000:3.0:1787560401.953151:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560401.953164:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9829c5400/0xe34191b05673ee5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ee57 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560401.953189:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9829c5400/0xe34191b05673ee5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ee57 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560401.953199:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9829c5400/0xe34191b05673ee5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee57 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560401.953208:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9829c5400, rc 0) 00000100:00100000:3.0:1787560401.953265:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7623:x1874392815518208:12345-0@lo:101: Request processed in 131us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560401.953272:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787560401.953341:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518208:0@lo:101: 00010000:00010000:0.0:1787560401.953356:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560401.953365:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560401.953461:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518336:0@lo:501: 00000100:00100000:0.0:1787560401.953487:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.953601:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b396b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.953637:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815518336 00000100:00100000:1.0:1787560401.953641:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815518336 00000100:00100000:1.0:1787560401.953664:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787560401.953671:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7623:x1874392815518336:12345-0@lo:501: 00000100:00100000:1.0:1787560401.954135:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7623:x1874392815518336:12345-0@lo:501: Request processed in 463us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.954143:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787560401.955344:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518336:0@lo:501: 00000100:00100000:2.0:1787560401.955392:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518464:0@lo:503: 00000100:00100000:2.0:1787560401.955447:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560401.956816:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988637240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560401.957133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815518464 00000100:00100000:0.0:1787560401.957143:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815518464 00000100:00100000:3.0:1787560401.957233:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787560401.957659:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7623:x1874392815518464:12345-0@lo:503: 00000100:00100000:2.0:1787560401.958309:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7623:x1874392815518464:12345-0@lo:503: Request processed in 1063us (2860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560401.958320:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787560401.958558:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518464:0@lo:503: 00000040:00080000:2.0:1787560401.959431:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560401.959506:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518592:0@lo:502: 00000100:00100000:2.0:1787560401.959558:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560401.959598:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988637240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560401.959650:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815518592 00000100:00100000:0.0:1787560401.959657:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815518592 00000100:00100000:0.0:1787560401.959706:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787560401.959715:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7623:x1874392815518592:12345-0@lo:502: 00000100:00100000:0.0:1787560401.960164:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7623:x1874392815518592:12345-0@lo:502: Request processed in 449us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.960171:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787560401.960426:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518592:0@lo:502: 00000040:00080000:2.0:1787560401.960770:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787560401.960822:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787560401.960892:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787560401.961095:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787560401.961137:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787560401.961197:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787560401.961232:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787560401.961264:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787560401.961315:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787560401.961352:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787560401.961387:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787560401.961451:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787560401.961487:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787560401.961524:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787560401.961586:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787560401.961624:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787560401.961657:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787560401.962235:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787560401.962279:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787560401.962314:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787560401.962365:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787560401.962403:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787560401.962435:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787560401.962481:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787560401.962516:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787560401.962551:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787560401.962599:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787560401.962656:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787560401.963196:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787560401.963254:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787560401.963292:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787560401.963323:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787560401.963351:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787560401.963410:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787560401.963446:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787560401.963486:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787560401.963521:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787560401.963570:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518720:0@lo:502: 00000100:00100000:2.0:1787560401.963646:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560401.963792:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988637240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560401.963874:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815518720 00000100:00100000:0.0:1787560401.963882:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815518720 00000100:00100000:0.0:1787560401.964104:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787560401.964114:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7623:x1874392815518720:12345-0@lo:502: 00000100:00100000:0.0:1787560401.964332:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7623:x1874392815518720:12345-0@lo:502: Request processed in 219us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560401.964340:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787560401.964498:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815518720:0@lo:502: 00000040:00080000:2.0:1787560401.964566:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787560401.964575:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787560401.965278:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787560401.965300:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93d882263370) 00000020:00000080:0.0:1787560401.965322:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787560401.965397:0:7638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d9bfc6d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787560401.965402:0:7638:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d9bfc6d000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787560401.965404:0:7638:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d9bfc6d000 3 00010000:00080000:0.0:1787560401.965431:0:7638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d881850800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.156@tcp at head 00010000:00010000:0.0:1787560401.967608:0:7638:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787560401.968277:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787560401.968316:0:7638:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787560401.968329:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe34191b05673ee6c 00000100:00080000:0.0:1787560401.968339:0:7638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560401.968345:0:7638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d881850800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1787560401.968383:0:7638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d98641e300 x1874392815518848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787560401.968448:0:7638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787560401.968546:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815518976:0@lo:400: 00000100:00100000:0.0:1787560401.968615:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.968663:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815519104:0@lo:400: 00000100:00100000:0.0:1787560401.968769:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560401.968788:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560401.968795:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815519232:0@lo:400: 00000100:00100000:0.0:1787560401.968830:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560401.968963:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874392815518848:0@lo:38: 00000100:00100000:1.0:1787560401.968994:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560401.969048:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815518976 00000100:00100000:1.0:1787560401.969055:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815518976 00000100:00100000:1.0:1787560401.969090:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815519104 00000100:00100000:1.0:1787560401.969093:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815519104 00000100:00100000:1.0:1787560401.969113:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815518848 00000100:00100000:1.0:1787560401.969116:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815518848 00000100:00100000:1.0:1787560401.969128:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560401.969136:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815518976:12345-0@lo:400: 00000100:00100000:1.0:1787560401.969192:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815518976:12345-0@lo:400: Request processed in 55us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.969199:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560401.969213:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560401.969220:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815519104:12345-0@lo:400: 00000100:00100000:1.0:1787560401.969249:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815519104:12345-0@lo:400: Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.969254:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560401.969265:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560401.969269:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1874392815518848:12345-0@lo:38: 00010000:00080000:1.0:1787560401.969288:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1787560401.969320:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe34191b05673ee73 00000004:00100000:1.0:1787560401.969334:0:5838:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787560401.969360:0:5838:0:(import.c:65:import_set_state_nolock()) ffff93d99859f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560401.969395:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874392815518848:12345-0@lo:38: Request processed in 124us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.969401:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560401.969422:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815519232 00000100:00100000:1.0:1787560401.969425:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815519232 00000100:00100000:1.0:1787560401.969450:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560401.969457:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815519232:12345-0@lo:400: 00000100:00100000:1.0:1787560401.969487:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815519232:12345-0@lo:400: Request processed in 31us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.969494:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787560401.969513:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560401.969517:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787560401.969553:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98641e300 x1874392815518848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560401.969563:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560401.969571:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787560401.969577:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787560401.969581:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787560401.969584:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d881850800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787560401.969589:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874392815518848:0@lo:38: 00010000:00080000:0.0:1787560401.970860:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98641f800 x1874392815518976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560401.970877:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815518976:0@lo:400: 00010000:00080000:1.0:1787560401.972512:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98641df80 x1874392815519232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560401.972528:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815519232:0@lo:400: 00010000:00080000:1.0:1787560401.972542:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98641ea00 x1874392815519104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560401.972550:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815519104:0@lo:400: 00000040:00080000:1.0:1787560401.976058:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1787560401.976425:0:7639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7639:1874392815519360:0@lo:901: 00000100:00100000:3.0:1787560401.976497:0:7639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560401.976534:0:7639:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9887ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.976776:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815519360 00000100:00100000:1.0:1787560401.976783:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815519360 00000100:00100000:1.0:1787560401.976842:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560401.976881:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1874392815519360:12345-0@lo:901: 00000100:00100000:1.0:1787560401.977468:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7639:x1874392815519360:12345-0@lo:901: Request processed in 589us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560401.977477:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787560401.977499:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:2.0:1787560401.978492:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787560401.978525:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787560401.978550:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560401.978562:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787560401.978606:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787560401.978608:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787560401.978610:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560401.978611:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560401.978612:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560401.978614:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560401.978615:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560401.978617:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560401.978618:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560401.978620:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560401.978621:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787560401.978625:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787560401.978627:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560401.978629:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787560401.978629:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560401.978631:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560401.978632:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560401.978633:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560401.978634:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560401.978635:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787560401.978636:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787560401.978637:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560401.978642:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787560401.978662:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787560401.978676:0:7623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815519488:0@lo:253: 00000100:00100000:2.0:1787560401.978731:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560401.978775:0:7623:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988637f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560401.979143:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815519488 00000100:00100000:1.0:1787560401.979150:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815519488 00000100:00100000:1.0:1787560401.979191:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787560401.979207:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7623:x1874392815519488:12345-0@lo:253: 20000000:01000000:1.0:1787560401.979234:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787560401.979247:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787560401.983524:0:7639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9b4225180 x1874392815519360/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787560417 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560401.983544:0:7639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7639:1874392815519360:0@lo:901: 20000000:01000000:3.0:1787560402.046198:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787560402.046223:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787560402.051476:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787560402.051489:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787560402.051514:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560402.051532:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d980030c00/0xe34191b05673edcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673edc4 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560402.051541:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560402.051585:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d980030c00/0xe34191b05673edcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673edc4 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560402.051600:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d980030c00/0xe34191b05673edcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673edc4 expref: 14 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560402.051615:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874392815519616:0@lo:104: 00000100:00100000:0.0:1787560402.051691:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560402.051755:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b396b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560402.051887:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815519616 00000100:00100000:2.0:1787560402.051895:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815519616 00000100:00100000:2.0:1787560402.051951:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560402.051961:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5853:x1874392815519616:12345-0@lo:104: 00010000:00010000:2.0:1787560402.051973:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560402.052773:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560402.052781:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:5853:x1874392815519616:12345-0@lo:104: Request processed in 821us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560402.052790:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787560402.052878:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560402.052886:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.052894:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da400 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:3.0:1787560402.052898:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.052908:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560402.052915:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560402.052920:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787560402.052952:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.052958:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560402.052978:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.052984:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21da400/0xe34191b05673edc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673edcb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053002:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560402.053003:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560402.053005:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560402.053018:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815519744:0@lo:103: 00000100:00100000:3.0:1787560402.053069:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560402.053120:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815519744 00000100:00100000:3.0:1787560402.053125:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815519744 00010000:00010000:3.0:1787560402.053145:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d980030c00/0xe34191b05673edcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673edc4 expref: 15 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560402.053168:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560402.053176:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e13850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:3311:x1874392815519744:12345-0@lo:103: 00010000:00010000:3.0:1787560402.053186:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560402.053191:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d980030c00/0xe34191b05673edcb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673edc4 expref: 15 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053201:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d980030c00/0xe34191b05673edcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673edc4 expref: 15 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053218:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053225:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787560402.053237:0:7630:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008357731s 00010000:00010000:3.0:1787560402.053242:0:7630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053248:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053254:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053271:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053277:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030800 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560402.053281:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053287:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053296:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560402.053305:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560402.053334:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e13850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:3311:x1874392815519744:12345-0@lo:103: Request processed in 158us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560402.053340:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560402.053394:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815519744:0@lo:103: 00010000:00010000:1.0:1787560402.054294:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980030c00/0xe34191b05673edcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673edc4 expref: 14 pid: 5832 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560402.054308:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1874392815519616:0@lo:104: 00010000:00010000:1.0:1787560402.054323:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560402.054331:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560402.054337:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560402.054343:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980030800/0xe34191b05673ee7a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560402.075216:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:7623:x1874392815519488:12345-0@lo:253: Request processed in 96000us (96474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560402.075232:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787560402.075414:0:7623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7623:1874392815519488:0@lo:253: 10000000:01000000:1.0:1787560402.075430:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787560402.075433:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787560402.075435:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787560402.075436:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560402.075436:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560402.075438:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560402.075439:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560402.075440:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560402.075441:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787560402.075443:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787560402.075444:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560402.075446:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787560402.075469:0:7623:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787560402.092541:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787560402.092735:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787560402.093517:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787560402.094435:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787560402.094726:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787560402.095437:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787560402.101811:0:7623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787560402.139693:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815519872:0@lo:13: 00000100:00100000:1.0:1787560402.139774:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560402.139863:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815519872 00000100:00100000:1.0:1787560402.139871:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815519872 00000100:00100000:1.0:1787560402.139921:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560402.139930:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815519872:12345-0@lo:13: 00002000:00000024:1.0:1787560402.139963:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560402.140511:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815519872:12345-0@lo:13: Request processed in 581us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560402.140519:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787560402.140563:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d98735df80 x1874392815519872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560402.140579:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815519872:0@lo:13: 00002000:00080000:0.0:1787560402.410408:0:7623:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787560402.410427:0:7623:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787560402.410468:0:7623:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787560402.410531:0:7623:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787560402.410546:0:7623:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787560402.410575:0:7623:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787560402.577379:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560403.602236:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560404.625181:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560405.649297:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560406.679875:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560407.251336:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815520000:0@lo:13: 00000100:00100000:1.0:1787560407.251407:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560407.251477:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815520000 00000100:00100000:1.0:1787560407.251484:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815520000 00000100:00100000:1.0:1787560407.251535:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560407.251544:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815520000:12345-0@lo:13: 00002000:00000024:1.0:1787560407.251576:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560407.251619:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815520000:12345-0@lo:13: Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560407.251626:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787560407.251646:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787560407.251711:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735df80 x1874392815520000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560407.251750:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815520000:0@lo:13: 00000100:00100000:2.0:1787560407.271122:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815520256:0@lo:400: 00000100:00100000:2.0:1787560407.271201:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560407.271272:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560407.271281:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815520384:0@lo:400: 00000100:00100000:2.0:1787560407.271313:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560407.271358:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815520256 00000100:00100000:2.0:1787560407.271365:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815520256 00000100:00100000:0.0:1787560407.271386:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815520128:0@lo:400: 00000100:00100000:2.0:1787560407.271419:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815520384 00000100:00100000:2.0:1787560407.271424:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815520384 00000100:00100000:0.0:1787560407.271430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560407.271467:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560407.271470:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560407.271478:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815520256:12345-0@lo:400: 00000100:00100000:0.0:1787560407.271480:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815520512:0@lo:400: 00000100:00100000:0.0:1787560407.271515:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560407.271544:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815520128 00000100:00100000:2.0:1787560407.271549:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815520256:12345-0@lo:400: Request processed in 71us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560407.271550:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815520128 00000100:00100000:2.0:1787560407.271560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560407.271579:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815520512 00000100:00100000:2.0:1787560407.271583:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815520512 00000100:00100000:0.0:1787560407.271585:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787560407.271596:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:3314:x1874392815520128:12345-0@lo:400: 00000100:00100000:2.0:1787560407.271608:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560407.271617:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815520384:12345-0@lo:400: 00000100:00100000:0.0:1787560407.271639:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:3314:x1874392815520128:12345-0@lo:400: Request processed in 45us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560407.271648:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787560407.271665:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815520384:12345-0@lo:400: Request processed in 50us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560407.271673:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560407.271690:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560407.271698:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815520512:12345-0@lo:400: 00000100:00100000:0.0:1787560407.271714:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815520128:0@lo:400: 00000100:00100000:2.0:1787560407.271739:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815520512:12345-0@lo:400: Request processed in 41us (223us total) trans 0 rc 0/0 00010000:00080000:0.0:1787560407.271742:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9ba338e00 x1874392815520512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560407.271749:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560407.271761:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815520512:0@lo:400: 00000100:00080000:0.0:1787560407.271803:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787560407.271808:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9ba339500 x1874392815520384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560407.271821:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815520384:0@lo:400: 00010000:00080000:0.0:1787560407.272269:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9ba33a300 x1874392815520256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560407.272282:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815520256:0@lo:400: 00010000:00010000:3.0:1787560407.695837:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560408.719147:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787560409.294938:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787560409.294947:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d986ace800 from 30 10000000:01000000:2.0:1787560409.294953:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560409.295001:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.295030:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.295039:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560409.295061:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815520640:0@lo:101: 00000100:00100000:2.0:1787560409.295139:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560409.295199:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988637540 going to sleep for 11 seconds 00000100:00100000:3.0:1787560409.295341:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815520640 00000100:00100000:3.0:1787560409.295349:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815520640 00000100:00100000:3.0:1787560409.295409:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787560409.295418:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815520640:12345-0@lo:101: 00010000:00010000:3.0:1787560409.295430:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560409.295448:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ee88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ee81 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560409.295472:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ee88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ee81 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560409.295483:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ee88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee81 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560409.295492:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9829c4a00, rc 0) 00000100:00100000:3.0:1787560409.295532:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815520640:12345-0@lo:101: Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560409.295539:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787560409.295584:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815520640:0@lo:101: 00010000:00010000:3.0:1787560409.295597:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560409.295607:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560409.295677:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815520768:0@lo:501: 00000100:00100000:3.0:1787560409.295705:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.295720:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503840 going to sleep for 11 seconds 00000100:00100000:3.0:1787560409.295732:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815520768 00000100:00100000:3.0:1787560409.295736:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815520768 00000100:00100000:3.0:1787560409.295756:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787560409.295762:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98328b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815520768:12345-0@lo:501: 00000100:00100000:3.0:1787560409.296145:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98328b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815520768:12345-0@lo:501: Request processed in 381us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560409.296161:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787560409.296193:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815520768:0@lo:501: 00000100:00100000:3.0:1787560409.296220:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815520896:0@lo:503: 00000100:00100000:3.0:1787560409.296255:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.296267:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503840 going to sleep for 11 seconds 00000100:00100000:3.0:1787560409.296279:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815520896 00000100:00100000:3.0:1787560409.296282:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815520896 00000100:00100000:3.0:1787560409.296303:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787560409.296308:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815520896:12345-0@lo:503: 00000100:00100000:3.0:1787560409.296579:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815520896:12345-0@lo:503: Request processed in 270us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560409.296585:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787560409.296745:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815520896:0@lo:503: 00000100:00100000:3.0:1787560409.297055:0:7925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7925:1874392815521024:0@lo:502: 00000100:00100000:3.0:1787560409.297091:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.297112:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815521024 00000100:00100000:3.0:1787560409.297116:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815521024 00000100:00100000:3.0:1787560409.297137:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787560409.297143:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7925:x1874392815521024:12345-0@lo:502: 00000100:00100000:3.0:1787560409.297361:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7925:x1874392815521024:12345-0@lo:502: Request processed in 218us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560409.297368:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787560409.297400:0:7925:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560409.297412:0:7925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7925:1874392815521024:0@lo:502: 00000100:00100000:3.0:1787560409.297456:0:7925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7925:1874392815521152:0@lo:502: 00000100:00100000:3.0:1787560409.297485:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.297503:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815521152 00000100:00100000:3.0:1787560409.297507:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815521152 00000100:00100000:3.0:1787560409.297525:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787560409.297530:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7925:x1874392815521152:12345-0@lo:502: 00000100:00100000:3.0:1787560409.297647:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:7925:x1874392815521152:12345-0@lo:502: Request processed in 117us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560409.297654:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787560409.297679:0:7925:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9834cc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560409.297690:0:7925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7925:1874392815521152:0@lo:502: 00000040:00080000:3.0:1787560409.297707:0:7925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787560409.297754:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787560409.297769:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787560409.297777:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560409.297787:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560409.297796:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787560409.297798:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787560409.297801:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787560409.297823:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560409.297830:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560409.297871:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560409.297883:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815521280:0@lo:101: 00000100:00100000:3.0:1787560409.297907:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.298093:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998480c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560409.298479:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815521280 00000100:00100000:2.0:1787560409.298484:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815521280 00000100:00100000:2.0:1787560409.298516:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787560409.298523:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815521280:12345-0@lo:101: 00010000:00010000:2.0:1787560409.298533:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560409.298545:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4463800/0xe34191b05673ee96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ee8f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.298565:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4463800/0xe34191b05673ee96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ee8f expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.298574:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4463800/0xe34191b05673ee96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee8f expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.298582:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463800, rc 0) 00000100:00100000:2.0:1787560409.298627:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815521280:12345-0@lo:101: Request processed in 103us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560409.298632:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787560409.298672:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4225180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815521280:0@lo:101: 00010000:00010000:2.0:1787560409.298694:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.298703:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560409.298747:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815521408:0@lo:501: 00000100:00100000:2.0:1787560409.298774:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560409.298787:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988637a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560409.298798:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815521408 00000100:00100000:2.0:1787560409.298801:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815521408 00000100:00100000:2.0:1787560409.298819:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787560409.298825:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815521408:12345-0@lo:501: 00000100:00100000:2.0:1787560409.299192:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815521408:12345-0@lo:501: Request processed in 366us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560409.299200:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787560409.299228:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815521408:0@lo:501: 00000100:00100000:2.0:1787560409.299252:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815521536:0@lo:503: 00000100:00100000:2.0:1787560409.299286:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560409.299299:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988637a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560409.299311:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815521536 00000100:00100000:2.0:1787560409.299315:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815521536 00000100:00100000:2.0:1787560409.299335:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787560409.299340:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815521536:12345-0@lo:503: 00000100:00100000:2.0:1787560409.299601:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815521536:12345-0@lo:503: Request processed in 259us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560409.299607:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787560409.299661:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815521536:0@lo:503: 00000100:00100000:2.0:1787560409.299826:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7926:1874392815521664:0@lo:502: 00000100:00100000:2.0:1787560409.300042:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560409.300060:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815521664 00000100:00100000:2.0:1787560409.300064:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815521664 00000100:00100000:2.0:1787560409.300086:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787560409.300092:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:7926:x1874392815521664:12345-0@lo:502: 00000100:00100000:2.0:1787560409.300242:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:7926:x1874392815521664:12345-0@lo:502: Request processed in 148us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560409.300248:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787560409.300280:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d988637540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560409.300292:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7926:1874392815521664:0@lo:502: 00000020:01000000:2.0:1787560409.300315:0:7926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560409.300324:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560409.300326:0:7926:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787560409.300331:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787560409.300333:0:7926:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787560409.300346:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7926:1874392815521792:0@lo:502: 00000100:00100000:2.0:1787560409.300375:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560409.300394:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815521792 00000100:00100000:2.0:1787560409.300397:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815521792 00000100:00100000:2.0:1787560409.300414:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787560409.300419:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:7926:x1874392815521792:12345-0@lo:502: 00000100:00100000:2.0:1787560409.300513:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:7926:x1874392815521792:12345-0@lo:502: Request processed in 93us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560409.300520:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787560409.300548:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b396b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560409.300565:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7926:1874392815521792:0@lo:502: 00000020:01000000:2.0:1787560409.300580:0:7926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560409.300584:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560409.300586:0:7926:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787560409.300589:0:7926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787560409.300652:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787560409.300665:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787560409.300674:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.300683:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560409.300692:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787560409.300694:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d982bfc800 from 30 10000000:01000000:2.0:1787560409.300697:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560409.300720:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.300728:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.300737:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560409.300747:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815521920:0@lo:101: 00000100:00100000:2.0:1787560409.300771:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560409.300784:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b396b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560409.300794:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815521920 00000100:00100000:2.0:1787560409.300797:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815521920 00000100:00100000:2.0:1787560409.300824:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787560409.300829:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815521920:12345-0@lo:101: 00010000:00010000:2.0:1787560409.300836:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560409.300869:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4462a00/0xe34191b05673eea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ee9d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.302415:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4462a00/0xe34191b05673eea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ee9d expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.302430:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4462a00/0xe34191b05673eea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee9d expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.302441:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4462a00, rc 0) 00000100:00100000:2.0:1787560409.302519:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815521920:12345-0@lo:101: Request processed in 1688us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560409.302528:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787560409.302600:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815521920:0@lo:101: 00010000:00010000:2.0:1787560409.302629:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560409.302639:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560409.302721:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522048:0@lo:501: 00000100:00100000:2.0:1787560409.302756:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560409.302788:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b396b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560409.302805:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815522048 00000100:00100000:2.0:1787560409.302810:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815522048 00000100:00100000:2.0:1787560409.303813:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787560409.303845:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815522048:12345-0@lo:501: 00000100:00100000:2.0:1787560409.306341:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815522048:12345-0@lo:501: Request processed in 2503us (3576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560409.306354:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787560409.309238:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522048:0@lo:501: 00000100:00100000:2.0:1787560409.309301:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522176:0@lo:503: 00000100:00100000:2.0:1787560409.309374:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560409.309449:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b396b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.309777:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815522176 00000100:00100000:1.0:1787560409.309785:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815522176 00000100:00100000:1.0:1787560409.309864:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787560409.309883:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815522176:12345-0@lo:503: 00000100:00100000:1.0:1787560409.310209:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815522176:12345-0@lo:503: Request processed in 336us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.310216:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787560409.312187:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522176:0@lo:503: 00000100:00100000:0.0:1787560409.312406:0:7928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7928:1874392815522304:0@lo:502: 00000100:00100000:0.0:1787560409.312488:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560409.312523:0:7928:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.313052:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815522304 00000100:00100000:1.0:1787560409.313059:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815522304 00000100:00100000:1.0:1787560409.313106:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787560409.313116:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:7928:x1874392815522304:12345-0@lo:502: 00000100:00100000:1.0:1787560409.313387:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:7928:x1874392815522304:12345-0@lo:502: Request processed in 271us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.313410:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787560409.313580:0:7928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7928:1874392815522304:0@lo:502: 00000100:00100000:0.0:1787560409.313643:0:7928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7928:1874392815522432:0@lo:502: 00000100:00100000:0.0:1787560409.313678:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560409.313711:0:7928:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.315044:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815522432 00000100:00100000:1.0:1787560409.315056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815522432 00000100:00100000:1.0:1787560409.315108:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787560409.315119:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:7928:x1874392815522432:12345-0@lo:502: 00000100:00100000:1.0:1787560409.315385:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:7928:x1874392815522432:12345-0@lo:502: Request processed in 267us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.315392:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787560409.315561:0:7928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7928:1874392815522432:0@lo:502: 00000040:00080000:0.0:1787560409.315593:0:7928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787560409.316133:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787560409.316152:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787560409.316163:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560409.316174:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560409.316184:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787560409.316187:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d982bfc800 from 5 10000000:01000000:0.0:1787560409.316189:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787560409.316223:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560409.316232:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560409.316242:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560409.316271:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522560:0@lo:101: 00000100:00100000:0.0:1787560409.316316:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560409.316346:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.317793:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815522560 00000100:00100000:1.0:1787560409.317805:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815522560 00000100:00100000:1.0:1787560409.317892:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787560409.317908:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815522560:12345-0@lo:101: 00010000:00010000:1.0:1787560409.318006:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560409.318026:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21daa00/0xe34191b05673eeb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673eeab expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318054:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21daa00/0xe34191b05673eeb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673eeab expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318064:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21daa00/0xe34191b05673eeb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673eeab expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318072:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21daa00, rc 0) 00000100:00100000:1.0:1787560409.318133:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815522560:12345-0@lo:101: Request processed in 227us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.318140:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787560409.318190:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522560:0@lo:101: 00010000:00010000:1.0:1787560409.318205:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318213:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560409.318267:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522688:0@lo:256: 00000100:00100000:1.0:1787560409.318303:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560409.318328:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d991cf56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.318340:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815522688 00000100:00100000:1.0:1787560409.318343:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815522688 00000100:00100000:1.0:1787560409.318364:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787560409.318369:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815522688:12345-0@lo:256: 20000000:01000000:1.0:1787560409.318390:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560409.318406:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560409.318409:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787560409.318480:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815522688:12345-0@lo:256: Request processed in 110us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.318487:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787560409.318515:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522688:0@lo:256: 10000000:01000000:1.0:1787560409.318556:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560409.318562:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318570:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560409.318578:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787560409.318580:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787560409.318582:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787560409.318596:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318604:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318622:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560409.318633:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522816:0@lo:101: 00000100:00100000:1.0:1787560409.318655:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560409.318666:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.318681:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815522816 00000100:00100000:1.0:1787560409.318685:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815522816 00000100:00100000:1.0:1787560409.318704:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787560409.318709:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815522816:12345-0@lo:101: 00010000:00010000:1.0:1787560409.318715:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560409.318722:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21db000/0xe34191b05673eec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673eeb9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318735:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21db000/0xe34191b05673eec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673eeb9 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318744:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21db000/0xe34191b05673eec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673eeb9 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318751:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db000, rc 0) 00000100:00100000:1.0:1787560409.318773:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815522816:12345-0@lo:101: Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.318779:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787560409.318805:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522816:0@lo:101: 00010000:00010000:1.0:1787560409.318813:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.318821:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560409.318877:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522944:0@lo:501: 00000100:00100000:1.0:1787560409.318898:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560409.318908:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.320028:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815522944 00000100:00100000:1.0:1787560409.320041:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815522944 00000100:00100000:1.0:1787560409.320076:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787560409.320083:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815522944:12345-0@lo:501: 00000100:00100000:1.0:1787560409.320317:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815522944:12345-0@lo:501: Request processed in 233us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.320324:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787560409.320359:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815522944:0@lo:501: 00000100:00100000:1.0:1787560409.320392:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815523072:0@lo:503: 00000100:00100000:1.0:1787560409.320423:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560409.320436:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.320444:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815523072 00000100:00100000:1.0:1787560409.320447:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815523072 00000100:00100000:1.0:1787560409.320465:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787560409.320470:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815523072:12345-0@lo:503: 00000100:00100000:1.0:1787560409.320738:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815523072:12345-0@lo:503: Request processed in 267us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.320744:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787560409.320772:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815523072:0@lo:503: 00000100:00100000:0.0:1787560409.332358:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7930:1874392815523200:0@lo:502: 00000100:00100000:0.0:1787560409.332459:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560409.332506:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.332563:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815523200 00000100:00100000:1.0:1787560409.332572:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815523200 00000100:00100000:1.0:1787560409.332627:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787560409.332639:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:7930:x1874392815523200:12345-0@lo:502: 00000100:00100000:1.0:1787560409.333155:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:7930:x1874392815523200:12345-0@lo:502: Request processed in 516us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.333163:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787560409.333623:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7930:1874392815523200:0@lo:502: 00000020:01000000:0.0:1787560409.333657:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787560409.333664:0:7930:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787560409.333673:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560409.333675:0:7930:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787560409.333681:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787560409.333685:0:7930:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.156@tcp to nid 0x20000c0a8c99c (192.168.201.156@tcp) 00000020:01000000:0.0:1787560409.333707:0:7930:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787560409.333710:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560409.333724:0:7930:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93d882264d28) 00000020:00000080:0.0:1787560409.333758:0:7930:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787560409.333764:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787560409.333890:0:7930:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787560409.333895:0:7930:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787560409.333902:0:7930:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673eece 00010000:00080000:0.0:1787560409.334049:0:7930:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d9bf87b000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.156@tcp at head 00010000:00010000:0.0:1787560409.334276:0:7930:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787560409.334647:0:7930:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787560409.334659:0:7930:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787560409.337739:0:7930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560409.338508:0:7930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560409.338569:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787560409.338640:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787560409.339329:0:7931:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787560409.339335:0:7931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787560409.340479:0:7930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787560409.340494:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787560409.340528:0:7930:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787560409.340550:0:7930:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe34191b05673eed5 00000100:00080000:0.0:1787560409.340560:0:7930:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560409.340566:0:7930:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d9bf87b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1787560409.340601:0:7930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d98641d500 x1874392815523328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560409.340674:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815523328:0@lo:8: 00000100:00100000:1.0:1787560409.340755:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560409.340844:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815523328 00000100:00100000:2.0:1787560409.340868:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815523328 00000100:00100000:2.0:1787560409.340924:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560409.340933:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874392815523328:12345-0@lo:8: 00010000:00080000:2.0:1787560409.340960:0:6685:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1787560409.340989:0:6685:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe34191b05673eedc 00002000:00100000:2.0:1787560409.341003:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93d882dfb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787560409.341007:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787560409.341010:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787560409.341115:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787560409.341251:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787560409.341273:0:6685:0:(import.c:65:import_set_state_nolock()) ffff93d882dfc000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787560409.341437:0:7930:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787560409.341499:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560409.341504:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560409.341505:0:7930:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787560409.341508:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560409.341512:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560409.341513:0:7930:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787560409.341515:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787560409.341517:0:7930:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787560409.341541:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7930:1874392815523456:0@lo:502: 00000100:00100000:0.0:1787560409.341587:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560409.341610:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560409.341772:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815523584:0@lo:400: 00000100:00100000:3.0:1787560409.341803:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.341826:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560409.341832:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815523968:0@lo:400: 00000100:00100000:3.0:1787560409.341873:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.341902:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815523712:0@lo:400: 00000100:00100000:3.0:1787560409.342122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.342144:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560409.342149:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815523840:0@lo:400: 00000100:00100000:3.0:1787560409.342172:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.342209:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815523584 00000100:00100000:3.0:1787560409.342214:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815523584 00000100:00100000:3.0:1787560409.342245:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815523968 00000100:00100000:3.0:1787560409.342248:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815523968 00000100:00100000:3.0:1787560409.342282:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815523712 00000100:00100000:3.0:1787560409.342285:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815523712 00000100:00100000:3.0:1787560409.342300:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787560409.342307:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815523584:12345-0@lo:400: 00000100:00100000:3.0:1787560409.342344:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815523584:12345-0@lo:400: Request processed in 37us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560409.342349:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787560409.342378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560409.342383:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815523968:12345-0@lo:400: 00000100:00100000:3.0:1787560409.342410:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815523968:12345-0@lo:400: Request processed in 27us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560409.342415:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560409.342424:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560409.342430:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815523712:12345-0@lo:400: 00000100:00100000:3.0:1787560409.342457:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815523712:12345-0@lo:400: Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560409.342462:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787560409.342484:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787560409.342513:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b4224380 x1874392815523968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560409.342526:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815523968:0@lo:400: 00010000:00080000:3.0:1787560409.342537:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b4227800 x1874392815523584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560409.342546:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815523584:0@lo:400: 00010000:00080000:3.0:1787560409.342571:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b4224000 x1874392815523712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560409.342579:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815523712:0@lo:400: 00000100:00100000:2.0:1787560409.344526:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874392815523328:12345-0@lo:8: Request processed in 3583us (3760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560409.344539:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560409.344568:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815523840 00000100:00100000:2.0:1787560409.344585:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815523840 00000100:00100000:2.0:1787560409.344672:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560409.344682:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815523840:12345-0@lo:400: 00000100:00100000:2.0:1787560409.344762:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815523840:12345-0@lo:400: Request processed in 82us (2588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560409.344769:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787560409.344862:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98641d500 x1874392815523328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560409.344882:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560409.344892:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787560409.344900:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787560409.344905:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787560409.344909:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9bf87b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787560409.345080:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787560409.345087:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815523328:0@lo:8: 00000100:00100000:1.0:1787560409.345140:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815523456 00000100:00100000:1.0:1787560409.345144:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815523456 00000100:00100000:1.0:1787560409.345171:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787560409.345178:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:7930:x1874392815523456:12345-0@lo:502: 00000100:00100000:1.0:1787560409.345399:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:7930:x1874392815523456:12345-0@lo:502: Request processed in 221us (3812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.345406:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000004:00080000:2.0:1787560409.345625:0:7931:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787560409.345732:0:7931:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 238098884223ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787560409.347751:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:7930:1874392815523456:0@lo:502: 00000020:01000000:1.0:1787560409.347793:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560409.347801:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560409.347803:0:7930:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787560409.347807:0:7930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1787560409.348068:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787560409.348085:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787560409.348095:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.348118:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560409.348129:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787560409.348131:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d9901ecd28 from 1 10000000:01000000:1.0:1787560409.348134:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787560409.348165:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.348173:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.348181:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560409.348199:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815524096:0@lo:101: 00000100:00100000:1.0:1787560409.348258:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560409.348292:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.348308:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815524096 00000100:00100000:1.0:1787560409.348313:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815524096 00010000:00080000:3.0:1787560409.348876:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b4227480 x1874392815523840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560409.348889:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815523840:0@lo:400: 00000100:00100000:1.0:1787560409.350125:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787560409.350137:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815524096:12345-0@lo:101: 00010000:00010000:1.0:1787560409.350153:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560409.350170:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21da800/0xe34191b05673eeea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673eee3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.350198:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21da800/0xe34191b05673eeea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673eee3 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.350224:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21da800/0xe34191b05673eeea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673eee3 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.350234:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21da800, rc 0) 00000100:00100000:1.0:1787560409.350302:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815524096:12345-0@lo:101: Request processed in 167us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.350309:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787560409.350363:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815524096:0@lo:101: 00010000:00010000:1.0:1787560409.350379:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.350387:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560409.350441:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815524224:0@lo:501: 00000100:00100000:1.0:1787560409.350470:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560409.350486:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.350499:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815524224 00000100:00100000:1.0:1787560409.350503:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815524224 00000100:00100000:1.0:1787560409.350527:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787560409.350533:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815524224:12345-0@lo:501: 00000100:00100000:1.0:1787560409.350729:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815524224:12345-0@lo:501: Request processed in 195us (258us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787560409.350736:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787560409.350764:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815524224:0@lo:501: 10000000:01000000:1.0:1787560409.350784:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787560409.350796:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560409.350804:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787560409.351336:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787560409.443754:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787560409.529762:0:7932:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787560409.529797:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815524352:0@lo:13: 00000100:00100000:1.0:1787560409.529800:0:7932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7932:1874392815524480:0@lo:7: 00000100:00100000:3.0:1787560409.529898:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560409.532130:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815524352 00000100:00100000:0.0:1787560409.532142:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815524352 00000100:00100000:0.0:1787560409.532201:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560409.532212:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815524352:12345-0@lo:13: 00002000:00000024:0.0:1787560409.532247:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787560409.532499:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560409.532553:0:7932:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d990125000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.532574:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815524480 00000100:00100000:1.0:1787560409.532578:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815524480 00000100:00100000:1.0:1787560409.532605:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560409.532639:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7932:x1874392815524480:12345-0@lo:7: 00000100:00100000:0.0:1787560409.540350:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874392815524352:12345-0@lo:13: Request processed in 8131us (10444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560409.540375:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787560409.540415:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787560409.541653:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735fb80 x1874392815524352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560409.541678:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815524352:0@lo:13: 00002000:00080000:1.0:1787560409.549431:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787560409.549440:0:6685:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787560409.549534:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7932:x1874392815524480:12345-0@lo:7: Request processed in 16918us (17031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.549544:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787560409.552122:0:7932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735c000 x1874392815524480/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787560425 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560409.552142:0:7932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7932:1874392815524480:0@lo:7: 00000004:00080000:3.0:1787560409.552159:0:7932:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787560409.552202:0:7932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4224000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7932:1874392815524608:0@lo:5: 00000100:00100000:3.0:1787560409.552269:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.552322:0:7932:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9834cc240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.552449:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815524608 00000100:00100000:1.0:1787560409.552457:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815524608 00000100:00100000:1.0:1787560409.552511:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560409.552521:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7932:x1874392815524608:12345-0@lo:5: 00002000:00080000:1.0:1787560409.552545:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787560409.552549:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787560409.553070:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7932:x1874392815524608:12345-0@lo:5: Request processed in 549us (799us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787560409.553077:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787560409.553271:0:7932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b4224000 x1874392815524608/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560425 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560409.553284:0:7932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4224000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7932:1874392815524608:0@lo:5: 00000004:00080000:3.0:1787560409.553294:0:7932:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787560409.553319:0:7932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4224380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7932:1874392815524736:0@lo:700: 00000100:00100000:3.0:1787560409.553357:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560409.553386:0:7932:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9834cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560409.553438:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815524736 00000100:00100000:0.0:1787560409.553443:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815524736 00000100:00100000:0.0:1787560409.553486:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560409.553495:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7932:x1874392815524736:12345-0@lo:700: 00000100:00100000:0.0:1787560409.553523:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1874392815524864:0@lo:700: 00000100:00100000:0.0:1787560409.553552:0:6691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560409.553581:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.553595:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815524864 00000100:00100000:1.0:1787560409.553622:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815524864 00000100:00100000:1.0:1787560409.553658:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560409.553666:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1874392815524864:12345-0@lo:700: 40000000:02000000:1.0:1787560409.592764:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787560409.599350:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6691:x1874392815524864:12345-0@lo:700: Request processed in 45676us (45788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560409.599365:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787560409.602691:0:6691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98641f800 x1874392815524864/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787560425 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560409.602712:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6691:1874392815524864:0@lo:700: 40000000:02000000:0.0:1787560409.602730:0:6691:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1787560409.737229:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7932:x1874392815524736:12345-0@lo:700: Request processed in 183723us (183859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560409.737251:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787560409.739165:0:7932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b4224380 x1874392815524736/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787560425 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560409.739184:0:7932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4224380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7932:1874392815524736:0@lo:700: 00000001:00080000:2.0:1787560409.740322:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1787560409.740345:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787560409.786739:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1787560409.848009:0:7932:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787560409.856392:0:7932:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7932:1874392815524992:0@lo:5: 00000100:00100000:0.0:1787560409.856476:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560409.856527:0:7932:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79b780 going to sleep for 11 seconds 00000100:00100000:1.0:1787560409.856957:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815524992 00000100:00100000:1.0:1787560409.856966:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815524992 00000100:00100000:1.0:1787560409.857010:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560409.857019:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7932:x1874392815524992:12345-0@lo:5: 00002000:00080000:2.0:1787560409.873422:0:6685:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787560409.873443:0:6685:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787560409.897893:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7932:x1874392815524992:12345-0@lo:5: Request processed in 40866us (41422us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787560409.897907:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787560409.900874:0:7932:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98641f800 x1874392815524992/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560425 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560409.900891:0:7932:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787560409.900910:0:7932:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93d98641f800 x1874392815524992/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560425 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560409.900934:0:7932:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7932:1874392815524992:0@lo:5: 00000004:00080000:1.0:1787560409.900949:0:7932:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:0.0:1787560410.422799:0:7990:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787560410.831978:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560411.855992:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560412.367324:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815525120:0@lo:13: 00000100:00100000:3.0:1787560412.367414:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560412.367625:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815525120 00000100:00100000:1.0:1787560412.367635:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815525120 00000100:00100000:1.0:1787560412.367714:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560412.367724:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815525120:12345-0@lo:13: 00002000:00000024:1.0:1787560412.367757:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560412.367808:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815525120:12345-0@lo:13: Request processed in 85us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560412.367837:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787560412.368014:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560412.368059:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735e300 x1874392815525120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560412.368089:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815525120:0@lo:13: 00010000:00010000:3.0:1787560412.881151:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560413.907972:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560414.417746:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815525632:0@lo:400: 00000100:00100000:0.0:1787560414.417815:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560414.417947:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815525248:0@lo:400: 00000100:00100000:0.0:1787560414.418646:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815525504:0@lo:400: 00000100:00100000:1.0:1787560414.420377:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815525632 00000100:00100000:1.0:1787560414.420391:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815525632 00000100:00100000:1.0:1787560414.420460:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560414.420470:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815525632:12345-0@lo:400: 00000100:00100000:2.0:1787560414.421708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560414.421763:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815525760:0@lo:400: 00000100:00100000:2.0:1787560414.425910:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560414.426005:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815525376:0@lo:400: 00000100:00100000:2.0:1787560414.426042:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560414.426061:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815525888:0@lo:400: 00000100:00100000:2.0:1787560414.426102:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560414.426141:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815525760 00000100:00100000:2.0:1787560414.426148:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815525760 00000100:00100000:2.0:1787560414.426197:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815525376 00000100:00100000:2.0:1787560414.426215:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815525376 00000100:00100000:2.0:1787560414.426243:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560414.426253:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815525760:12345-0@lo:400: 00000100:00100000:2.0:1787560414.426304:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815525760:12345-0@lo:400: Request processed in 53us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560414.426311:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560414.426327:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560414.426333:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815525376:12345-0@lo:400: 00000100:00100000:2.0:1787560414.426363:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba33aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815525376:12345-0@lo:400: Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560414.426369:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560414.426391:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560414.426399:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1787560414.427830:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf983100 x1874392815525376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560414.428153:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815525376:0@lo:400: 00010000:00080000:2.0:1787560414.428206:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf981880 x1874392815525760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560414.428217:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815525760:0@lo:400: 00000100:00100000:2.0:1787560414.428254:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815525888 00000100:00100000:2.0:1787560414.428260:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815525888 00000100:00100000:2.0:1787560414.428297:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560414.428307:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560414.428314:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815525888:12345-0@lo:400: 00000100:00100000:2.0:1787560414.428378:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815525888:12345-0@lo:400: Request processed in 62us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560414.428395:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787560414.428426:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf982680 x1874392815525888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560414.428436:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815525888:0@lo:400: 00000100:00100000:0.0:1787560414.429006:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560414.430574:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815525632:12345-0@lo:400: Request processed in 10100us (12752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560414.430588:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787560414.430620:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560414.430626:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560414.430629:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560414.430647:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815525248 00000100:00100000:1.0:1787560414.430655:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815525248 00000100:00100000:1.0:1787560414.430693:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787560414.430702:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815525248:12345-0@lo:400: 00000100:00100000:1.0:1787560414.430753:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815525248:12345-0@lo:400: Request processed in 52us (9049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560414.430759:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:3.0:1787560414.431001:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf980e00 x1874392815525632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560414.431016:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815525632:0@lo:400: 00000100:00100000:0.0:1787560414.433730:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815525504 00000100:00100000:0.0:1787560414.433742:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815525504 00000100:00100000:0.0:1787560414.433840:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560414.433876:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815525504:12345-0@lo:400: 00000100:00100000:0.0:1787560414.433959:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815525504:12345-0@lo:400: Request processed in 110us (4952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560414.433966:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787560414.434012:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf980a80 x1874392815525504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560414.434026:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815525504:0@lo:400: 00000100:00080000:0.0:1787560414.434060:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560414.444799:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815525248:0@lo:400: 00010000:00010000:2.0:1787560414.927452:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560414.927612:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815526016:0@lo:13: 00000100:00100000:2.0:1787560414.927677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560414.927919:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815526016 00000100:00100000:1.0:1787560414.927927:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815526016 00000100:00100000:1.0:1787560414.927973:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560414.927981:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815526016:12345-0@lo:13: 00002000:00000024:1.0:1787560414.928014:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560414.928061:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815526016:12345-0@lo:13: Request processed in 81us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560414.928068:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787560414.928150:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735e680 x1874392815526016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560414.928169:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815526016:0@lo:13: 00000001:00080000:2.0:1787560415.121257:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787560415.950994:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560416.975038:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560417.231822:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560417.232953:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788238464 00000100:00100000:1.0:1787560417.232964:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788238464 00000100:00100000:1.0:1787560417.233008:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 113 00000100:00100000:1.0:1787560417.233017:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2341:x1874392788238464:12345-192.168.201.56@tcp:250: 00010000:00080000:1.0:1787560417.233044:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 194701de-fe21-4f70-a6ed-c87f3844b85e@192.168.201.56@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1787560417.233071:0:5832:0:(genops.c:1385:class_connect()) connect: client 194701de-fe21-4f70-a6ed-c87f3844b85e, cookie 0xe34191b05673eef1 00000100:00080000:1.0:1787560417.233196:0:5832:0:(import.c:65:import_set_state_nolock()) ffff93d9894cb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560417.233276:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+5:2341:x1874392788238464:12345-192.168.201.56@tcp:250: Request processed in 259us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560417.233283:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 113 00000100:00100000:3.0:1787560417.247465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560417.247550:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788238592 00000100:00100000:1.0:1787560417.247560:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788238592 00000100:00100000:1.0:1787560417.247612:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:1.0:1787560417.247622:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+5:5573:x1874392788238592:12345-192.168.201.56@tcp:101: 00010000:00010000:1.0:1787560417.247636:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560417.247653:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21da400/0xe34191b05673eef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf921ac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560417.247679:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21da400/0xe34191b05673eef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921ac expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560417.247690:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21da400/0xe34191b05673eef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921ac expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560417.247699:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21da400, rc 0) 00000100:00100000:1.0:1787560417.247760:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+6:5573:x1874392788238592:12345-192.168.201.56@tcp:101: Request processed in 139us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560417.247767:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:0.0:1787560417.255546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560417.255627:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788238720 00000100:00100000:3.0:1787560417.255638:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788238720 00000100:00100000:3.0:1787560417.255691:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00100000:3.0:1787560417.255701:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+6:5573:x1874392788238720:12345-192.168.201.56@tcp:501: 00000100:00100000:3.0:1787560417.256089:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+6:5573:x1874392788238720:12345-192.168.201.56@tcp:501: Request processed in 388us (552us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560417.256097:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00100000:3.0:1787560417.259026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560417.259108:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788238848 00000100:00100000:2.0:1787560417.259118:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788238848 00000100:00100000:2.0:1787560417.259165:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 116 00000100:00100000:2.0:1787560417.259175:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+6:5573:x1874392788238848:12345-192.168.201.56@tcp:101: 00010000:00010000:2.0:1787560417.259188:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560417.259206:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4463c00/0xe34191b05673eeff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf921b3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560417.259232:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4463c00/0xe34191b05673eeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921b3 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560417.259243:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4463c00/0xe34191b05673eeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921b3 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560417.259266:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463c00, rc 0) 00000100:00100000:2.0:1787560417.259328:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+7:5573:x1874392788238848:12345-192.168.201.56@tcp:101: Request processed in 155us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560417.259336:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 116 00000100:00100000:0.0:1787560417.272270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560417.272409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788238976 00000100:00100000:1.0:1787560417.272419:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788238976 00000100:00100000:1.0:1787560417.272470:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 117 00000100:00100000:1.0:1787560417.272489:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+7:5573:x1874392788238976:12345-192.168.201.56@tcp:501: 00000100:00100000:1.0:1787560417.272923:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+8:5573:x1874392788238976:12345-192.168.201.56@tcp:501: Request processed in 435us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560417.272932:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 117 00000100:00100000:0.0:1787560417.281636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560417.281716:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788239104 00000100:00100000:3.0:1787560417.281725:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788239104 00000100:00100000:3.0:1787560417.281790:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:3.0:1787560417.281800:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+8:5573:x1874392788239104:12345-192.168.201.56@tcp:503: 00000100:00100000:2.0:1787560417.282413:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+8:5573:x1874392788239104:12345-192.168.201.56@tcp:503: Request processed in 611us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560417.282422:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:3.0:1787560417.287649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560417.287758:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788239232 00000100:00100000:2.0:1787560417.287768:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788239232 00000100:00100000:2.0:1787560417.287915:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00100000:2.0:1787560417.287925:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+8:5591:x1874392788239232:12345-192.168.201.56@tcp:502: 00000100:00100000:2.0:1787560417.288264:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+8:5591:x1874392788239232:12345-192.168.201.56@tcp:502: Request processed in 339us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560417.288272:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00100000:0.0:1787560417.315543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560417.315632:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788239360 00000100:00100000:1.0:1787560417.315642:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788239360 00000100:00100000:1.0:1787560417.315695:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:1.0:1787560417.315705:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+8:5591:x1874392788239360:12345-192.168.201.56@tcp:502: 00000100:00100000:1.0:1787560417.316005:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+8:5591:x1874392788239360:12345-192.168.201.56@tcp:502: Request processed in 300us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560417.316012:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:0.0:1787560417.329799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560417.329894:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788239488 00000100:00100000:2.0:1787560417.329904:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788239488 00000100:00100000:2.0:1787560417.329958:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00100000:2.0:1787560417.329967:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+8:5573:x1874392788239488:12345-192.168.201.56@tcp:101: 00010000:00010000:2.0:1787560417.329982:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560417.329999:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4462000/0xe34191b05673ef06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf921dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560417.330026:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4462000/0xe34191b05673ef06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921dd expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560417.330037:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4462000/0xe34191b05673ef06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921dd expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560417.330046:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4462000, rc 0) 00000100:00100000:2.0:1787560417.330112:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5573:x1874392788239488:12345-192.168.201.56@tcp:101: Request processed in 146us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560417.330119:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00100000:3.0:1787560417.337409:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560417.337515:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788239616 00000100:00100000:2.0:1787560417.337526:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788239616 00000100:00100000:2.0:1787560417.337581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 122 00000100:00100000:2.0:1787560417.337591:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5573:x1874392788239616:12345-192.168.201.56@tcp:256: 20000000:01000000:2.0:1787560417.337614:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787560417.337638:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787560417.337641:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787560417.337644:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787560417.337647:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787560417.343424:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5573:x1874392788239616:12345-192.168.201.56@tcp:256: Request processed in 5822us (6011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560417.343438:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 122 00000100:00100000:0.0:1787560417.348704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560417.348824:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788239744 00000100:00100000:1.0:1787560417.348834:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788239744 00000100:00100000:1.0:1787560417.348924:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 123 00000100:00100000:1.0:1787560417.348934:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5573:x1874392788239744:12345-192.168.201.56@tcp:101: 00010000:00010000:1.0:1787560417.348950:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560417.348967:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21db200/0xe34191b05673ef0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf921e4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560417.348993:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21db200/0xe34191b05673ef0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921e4 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560417.349004:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21db200/0xe34191b05673ef0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921e4 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560417.349030:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db200, rc 0) 00000100:00100000:1.0:1787560417.349230:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5573:x1874392788239744:12345-192.168.201.56@tcp:101: Request processed in 296us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560417.349237:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 123 00000100:00100000:0.0:1787560417.353220:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560417.353589:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788239872 00000100:00100000:2.0:1787560417.353599:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788239872 00000100:00100000:2.0:1787560417.353683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:2.0:1787560417.353693:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5573:x1874392788239872:12345-192.168.201.56@tcp:501: 00000100:00100000:2.0:1787560417.354007:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5573:x1874392788239872:12345-192.168.201.56@tcp:501: Request processed in 315us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560417.354015:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:3.0:1787560417.355830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560417.356498:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788240000 00000100:00100000:1.0:1787560417.356507:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788240000 00000100:00100000:1.0:1787560417.356544:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 125 00000100:00100000:1.0:1787560417.356553:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5573:x1874392788240000:12345-192.168.201.56@tcp:503: 00000100:00100000:1.0:1787560417.357026:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5573:x1874392788240000:12345-192.168.201.56@tcp:503: Request processed in 472us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560417.357034:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 125 00000100:00100000:3.0:1787560417.360258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560417.360685:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788240128 00000100:00100000:1.0:1787560417.360696:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788240128 00000100:00100000:1.0:1787560417.360751:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 126 00000100:00100000:1.0:1787560417.360762:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5595:x1874392788240128:12345-192.168.201.56@tcp:502: 00000100:00100000:1.0:1787560417.361033:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5595:x1874392788240128:12345-192.168.201.56@tcp:502: Request processed in 272us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560417.361040:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 126 00000100:00100000:3.0:1787560417.363918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560417.364791:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788240256 00000100:00100000:1.0:1787560417.364802:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788240256 00000100:00100000:1.0:1787560417.364884:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 127 00000100:00100000:1.0:1787560417.364902:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5595:x1874392788240256:12345-192.168.201.56@tcp:502: 00000100:00100000:1.0:1787560417.365122:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5595:x1874392788240256:12345-192.168.201.56@tcp:502: Request processed in 223us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560417.365139:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 127 00000100:00100000:3.0:1787560417.369785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560417.370003:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788240384 00000100:00100000:2.0:1787560417.370012:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788240384 00000100:00100000:2.0:1787560417.370057:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:2.0:1787560417.370066:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2341:x1874392788240384:12345-192.168.201.56@tcp:38: 00010000:00080000:2.0:1787560417.370093:0:6706:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1787560417.370148:0:6706:0:(genops.c:1385:class_connect()) connect: client 3e6b7760-d76b-45e8-8d98-861d14ecc789, cookie 0xe34191b05673ef14 00000004:00100000:2.0:1787560417.370175:0:6706:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787560417.370181:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787560417.412162:0:6706:0:(import.c:65:import_set_state_nolock()) ffff93d881251800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560417.412242:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2341:x1874392788240384:12345-192.168.201.56@tcp:38: Request processed in 42174us (42473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560417.412453:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:3.0:1787560417.487569:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815526144:0@lo:13: 00000100:00100000:3.0:1787560417.487655:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560417.487831:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815526144 00000100:00100000:1.0:1787560417.487839:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815526144 00000100:00100000:1.0:1787560417.487926:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560417.487935:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815526144:12345-0@lo:13: 00002000:00000024:1.0:1787560417.487967:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560417.488010:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815526144:12345-0@lo:13: Request processed in 76us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560417.488017:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787560417.488096:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735c380 x1874392815526144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560417.488115:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815526144:0@lo:13: 00000100:00080000:0.0:1787560417.488268:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787560417.999530:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560418.416249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560418.416295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560418.416405:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788240512 00000100:00100000:2.0:1787560418.416415:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788240512 00000100:00100000:2.0:1787560418.416497:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788240640 00000100:00100000:2.0:1787560418.416500:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788240640 00000100:00100000:2.0:1787560418.416526:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:2.0:1787560418.416536:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:0:x1874392788240512:12345-192.168.201.56@tcp:41: 00000004:00000024:2.0:1787560418.416605:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787560418.416679:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:0:x1874392788240512:12345-192.168.201.56@tcp:41: Request processed in 145us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560418.416686:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:2.0:1787560418.416702:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:2.0:1787560418.416709:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5573:x1874392788240640:12345-192.168.201.56@tcp:41: 00000004:00000024:2.0:1787560418.416719:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787560418.416737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5573:x1874392788240640:12345-192.168.201.56@tcp:41: Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560418.416744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00080000:1.0:1787560418.417258:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560418.422070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560418.422216:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788240768 00000100:00100000:2.0:1787560418.422227:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788240768 00000100:00100000:2.0:1787560418.422299:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:2.0:1787560418.422310:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5573:x1874392788240768:12345-192.168.201.56@tcp:40: 00000100:00100000:2.0:1787560418.422408:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5573:x1874392788240768:12345-192.168.201.56@tcp:40: Request processed in 100us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560418.422417:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:2.0:1787560418.431566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560418.431663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560418.431685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560418.431708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560418.431748:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788240896 00000100:00100000:2.0:1787560418.431758:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788240896 00000100:00100000:2.0:1787560418.431797:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788241024 00000100:00100000:2.0:1787560418.431800:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788241024 00000100:00100000:2.0:1787560418.431816:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:2.0:1787560418.431826:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1874392788240896:12345-192.168.201.56@tcp:8: 00010000:00080000:2.0:1787560418.431896:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:2.0:1787560418.431932:0:6684:0:(genops.c:1385:class_connect()) connect: client 3e6b7760-d76b-45e8-8d98-861d14ecc789, cookie 0xe34191b05673ef1b 00002000:00100000:2.0:1787560418.431946:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e6b7760-d76b-45e8-8d98-861d14ecc789/ffff93d881257800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787560418.431959:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787560418.432152:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788241280 00000100:00100000:3.0:1787560418.432158:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788241280 00000100:00100000:3.0:1787560418.432202:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 128 00000100:00100000:3.0:1787560418.432213:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2343:x1874392788241280:12345-192.168.201.56@tcp:400: 00000100:00100000:3.0:1787560418.432284:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2343:x1874392788241280:12345-192.168.201.56@tcp:400: Request processed in 73us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560418.432294:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 128 00002000:00080000:2.0:1787560418.432335:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787560418.432349:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00080000:2.0:1787560418.432360:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93d881255000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560418.432385:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2341:x1874392788240896:12345-192.168.201.56@tcp:8: Request processed in 560us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560418.432392:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:3.0:1787560418.432664:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1874392788241024:12345-192.168.201.56@tcp:8: 00010000:00080000:3.0:1787560418.432685:0:8101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:3.0:1787560418.432756:0:8101:0:(genops.c:1385:class_connect()) connect: client 3e6b7760-d76b-45e8-8d98-861d14ecc789, cookie 0xe34191b05673ef22 00002000:00100000:3.0:1787560418.432763:0:8101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3e6b7760-d76b-45e8-8d98-861d14ecc789/ffff93d9b38e5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787560418.432780:0:8101:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787560418.433054:0:8101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787560418.433073:0:8101:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560418.433116:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2341:x1874392788241024:12345-192.168.201.56@tcp:8: Request processed in 454us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560418.433135:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:1.0:1787560418.433638:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788241152 00000100:00100000:1.0:1787560418.433645:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788241152 00000100:00100000:1.0:1787560418.433713:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:1.0:1787560418.433720:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5573:x1874392788241152:12345-192.168.201.56@tcp:33: 00000004:00080000:2.0:1787560418.452958:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 19177us 00000004:00200000:1.0:1787560418.464911:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787560418.465108:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5573:x1874392788241152:12345-192.168.201.56@tcp:33: Request processed in 31379us (33542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560418.465120:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:0.0:1787560418.648729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560418.649022:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788241408 00000100:00100000:2.0:1787560418.649060:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788241408 00000100:00100000:2.0:1787560418.649152:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:2.0:1787560418.649167:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5612:x1874392788241408:12345-192.168.201.56@tcp:101: 00010000:00010000:2.0:1787560418.649197:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560418.651548:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463200/0xe34191b05673ef29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9220e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560418.651639:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673ef30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560418.651672:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673ef30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560418.651687:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673ef30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560418.654922:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787560418.654934:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560418.655079:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673ef30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560418.657078:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463200/0xe34191b05673ef29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9220e expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560418.657127:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673ef30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9220e expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560418.657138:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:2.0:1787560418.657142:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560418.657145:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463400, rc 0) 00000100:00100000:2.0:1787560418.657263:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:5612:x1874392788241408:12345-192.168.201.56@tcp:101: Request processed in 8098us (8555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560418.657274:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00010000:00010000:3.0:1787560419.025418:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560419.539255:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560419.539292:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815526272:0@lo:400: 00000100:00100000:3.0:1787560419.539411:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560419.539601:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815526272 00000100:00100000:0.0:1787560419.539618:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815526272 00000100:00100000:0.0:1787560419.539704:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787560419.539723:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815526272:12345-0@lo:400: 00000100:00100000:2.0:1787560419.539799:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815526528:0@lo:400: 00000100:00100000:0.0:1787560419.539820:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815526272:12345-0@lo:400: Request processed in 104us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560419.539830:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787560419.539905:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815526400:0@lo:400: 00000100:00100000:1.0:1787560419.540182:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815526784:0@lo:400: 00000100:00100000:2.0:1787560419.540300:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560419.540424:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560419.540484:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815526656:0@lo:400: 00000100:00100000:3.0:1787560419.540522:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560419.540562:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815526272:0@lo:400: 00000100:00100000:3.0:1787560419.540620:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815526656 00000100:00100000:3.0:1787560419.540626:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815526656 00000100:00100000:3.0:1787560419.540676:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560419.540685:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815526656:12345-0@lo:400: 00000100:00100000:3.0:1787560419.540730:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815526656:12345-0@lo:400: Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560419.540737:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787560419.540770:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf8a6d80 x1874392815526656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560419.540783:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815526656:0@lo:400: 00000100:00080000:1.0:1787560419.541252:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560419.544155:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560419.544244:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815526528 00000100:00100000:0.0:1787560419.544256:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815526528 00000100:00100000:0.0:1787560419.544329:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815526400 00000100:00100000:0.0:1787560419.544332:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815526400 00000100:00100000:0.0:1787560419.544375:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787560419.544387:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815526528:12345-0@lo:400: 00000100:00100000:0.0:1787560419.544495:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815526528:12345-0@lo:400: Request processed in 110us (4647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560419.544504:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787560419.544526:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787560419.544534:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815526400:12345-0@lo:400: 00000100:00080000:2.0:1787560419.545879:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560419.545946:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815526528:0@lo:400: 00000100:00100000:2.0:1787560419.546042:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815526400:0@lo:400: 00000100:00100000:2.0:1787560419.546057:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815526912:0@lo:400: 00000100:00100000:2.0:1787560419.546323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560419.546411:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815526912 00000100:00100000:2.0:1787560419.546418:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815526912 00000100:00100000:2.0:1787560419.546505:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560419.546516:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815526912:12345-0@lo:400: 00000100:00100000:2.0:1787560419.546666:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815526912:12345-0@lo:400: Request processed in 51us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560419.546674:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787560419.546696:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787560419.546714:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf8a4a80 x1874392815526912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560419.546726:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787560419.546738:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815526912:0@lo:400: 00000100:00100000:0.0:1787560419.548264:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815526400:12345-0@lo:400: Request processed in 31us (4140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560419.548281:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560419.548771:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815526784 00000100:00100000:2.0:1787560419.548780:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815526784 00000100:00080000:0.0:1787560419.548894:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560419.548992:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560419.549031:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815526784:12345-0@lo:400: 00000100:00100000:2.0:1787560419.549119:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815526784:12345-0@lo:400: Request processed in 84us (4965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560419.549126:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560419.549195:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815526784:0@lo:400: 00010000:00010000:3.0:1787560420.047217:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560420.049111:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815527040:0@lo:13: 00000100:00100000:2.0:1787560420.049210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560420.051309:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815527040 00000100:00100000:1.0:1787560420.051339:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815527040 00000100:00100000:1.0:1787560420.051433:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560420.051447:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815527040:12345-0@lo:13: 00002000:00000024:1.0:1787560420.051480:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560420.051607:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815527040:12345-0@lo:13: Request processed in 163us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560420.051616:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787560420.054781:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735d500 x1874392815527040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560420.054818:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815527040:0@lo:13: 00010000:00010000:2.0:1787560421.074108:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560421.097274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560421.097469:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788241536 00000100:00100000:0.0:1787560421.097482:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788241536 00000100:00100000:0.0:1787560421.097590:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:0.0:1787560421.097612:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:5665:x1874392788241536:12345-192.168.201.56@tcp:41: 00000004:00000024:0.0:1787560421.097707:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787560421.098061:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:5665:x1874392788241536:12345-192.168.201.56@tcp:41: Request processed in 459us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560421.098081:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00080000:2.0:1787560421.098453:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560421.101916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560421.102143:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788241664 00000100:00100000:1.0:1787560421.102161:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788241664 00000100:00100000:1.0:1787560421.102380:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:1.0:1787560421.102422:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5665:x1874392788241664:12345-192.168.201.56@tcp:13: 00002000:00000024:1.0:1787560421.102484:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560421.102582:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5665:x1874392788241664:12345-192.168.201.56@tcp:13: Request processed in 190us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560421.102591:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00080000:2.0:1787560421.103241:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560421.104873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560421.104968:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788241792 00000100:00100000:0.0:1787560421.104984:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788241792 00000100:00080000:2.0:1787560421.105624:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560421.105732:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:0.0:1787560421.106003:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5665:x1874392788241792:12345-192.168.201.56@tcp:13: 00002000:00000024:0.0:1787560421.106340:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560421.106620:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:5665:x1874392788241792:12345-192.168.201.56@tcp:13: Request processed in 873us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560421.106630:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00010000:00010000:1.0:1787560422.103139:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560422.610644:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815527168:0@lo:13: 00000100:00100000:0.0:1787560422.610759:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560422.611219:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815527168 00000100:00100000:0.0:1787560422.611230:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815527168 00000100:00100000:0.0:1787560422.611315:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560422.611336:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815527168:12345-0@lo:13: 00002000:00000024:0.0:1787560422.611448:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560422.611516:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815527168:12345-0@lo:13: Request processed in 189us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560422.611525:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787560422.611554:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787560422.620611:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf981f80 x1874392815527168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560422.620660:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815527168:0@lo:13: 00000001:00100000:3.0:1787560422.758032:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000001:00100000:2.0:1787560422.765514:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00010000:00010000:3.0:1787560423.128048:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787560423.297435:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000100:00100000:3.0:1787560423.860212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560423.860926:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788241920 00000100:00100000:2.0:1787560423.860941:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788241920 00000100:00100000:2.0:1787560423.861025:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:2.0:1787560423.861038:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2345:x1874392788241920:12345-192.168.201.56@tcp:400: 00000100:00100000:2.0:1787560423.864501:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2345:x1874392788241920:12345-192.168.201.56@tcp:400: Request processed in 3445us (4284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560423.864522:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:3.0:1787560423.873052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560423.873965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560423.874124:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788242176 00000100:00100000:2.0:1787560423.874138:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788242176 00000100:00100000:2.0:1787560423.874256:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:2.0:1787560423.874269:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788242176:12345-192.168.201.56@tcp:400: 00000100:00100000:3.0:1787560423.874350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560423.874411:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788242176:12345-192.168.201.56@tcp:400: Request processed in 145us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560423.874421:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00080000:1.0:1787560423.874421:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560423.874437:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788242304 00000100:00100000:2.0:1787560423.874440:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788242304 00000100:00080000:1.0:1787560423.874465:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560423.874475:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:2.0:1787560423.874482:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba33b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788242304:12345-192.168.201.56@tcp:400: 00000100:00100000:2.0:1787560423.878693:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba33b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788242304:12345-192.168.201.56@tcp:400: Request processed in 4191us (4323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560423.878714:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:0.0:1787560423.881635:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788242048 00000100:00100000:0.0:1787560423.881655:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788242048 00000100:00100000:0.0:1787560423.881779:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:0.0:1787560423.881792:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788242048:12345-192.168.201.56@tcp:400: 00000100:00100000:0.0:1787560423.881934:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788242048:12345-192.168.201.56@tcp:400: Request processed in 144us (7973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560423.881943:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00080000:2.0:1787560423.883546:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787560424.143499:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560424.657206:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815527680:0@lo:400: 00000100:00100000:1.0:1787560424.657284:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560424.657336:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787560424.657342:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815527296:0@lo:400: 00000100:00100000:1.0:1787560424.657406:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560424.657426:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815527808:0@lo:400: 00000100:00100000:1.0:1787560424.657447:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560424.657470:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815527424:0@lo:400: 00000100:00100000:1.0:1787560424.657502:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560424.657517:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815527936:0@lo:400: 00000100:00100000:1.0:1787560424.657533:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560424.657546:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560424.657550:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815527552:0@lo:400: 00000100:00100000:1.0:1787560424.657566:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560424.657593:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815527680 00000100:00100000:1.0:1787560424.657609:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815527680 00000100:00100000:1.0:1787560424.657878:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815527936 00000100:00100000:1.0:1787560424.657882:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815527936 00000100:00100000:1.0:1787560424.657908:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560424.657915:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815527680:12345-0@lo:400: 00000100:00100000:1.0:1787560424.657962:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815527680:12345-0@lo:400: Request processed in 47us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560424.657968:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560424.657982:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560424.657987:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815527936:12345-0@lo:400: 00000100:00100000:1.0:1787560424.658012:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815527936:12345-0@lo:400: Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560424.658017:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560424.658033:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815527296 00000100:00100000:1.0:1787560424.658036:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815527296 00000100:00100000:1.0:1787560424.658056:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787560424.658061:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815527296:12345-0@lo:400: 00000100:00100000:1.0:1787560424.658084:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815527296:12345-0@lo:400: Request processed in 24us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560424.658089:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787560424.658120:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815527808 00000100:00100000:1.0:1787560424.658123:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815527808 00000100:00100000:1.0:1787560424.658143:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815527424 00000100:00100000:1.0:1787560424.658145:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815527424 00000100:00100000:1.0:1787560424.658154:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815527552 00000100:00100000:1.0:1787560424.658156:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815527552 00000100:00100000:1.0:1787560424.658167:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560424.658173:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815527808:12345-0@lo:400: 00000100:00100000:1.0:1787560424.658198:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815527808:12345-0@lo:400: Request processed in 25us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560424.658203:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560424.658212:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560424.658217:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815527424:12345-0@lo:400: 00000100:00100000:1.0:1787560424.658236:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815527424:12345-0@lo:400: Request processed in 19us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560424.658299:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560424.658311:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787560424.658317:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815527552:12345-0@lo:400: 00000100:00100000:1.0:1787560424.658340:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815527552:12345-0@lo:400: Request processed in 24us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560424.658356:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787560424.658555:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560424.658560:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560424.658562:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560424.658600:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815527552:0@lo:400: 00000100:00100000:1.0:1787560424.658620:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815527424:0@lo:400: 00010000:00080000:1.0:1787560424.658631:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735d500 x1874392815527936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560424.658718:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815527936:0@lo:400: 00000100:00100000:1.0:1787560424.658750:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815527296:0@lo:400: 00000100:00100000:1.0:1787560424.658759:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815527808:0@lo:400: 00010000:00080000:1.0:1787560424.658770:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735dc00 x1874392815527680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560424.658778:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815527680:0@lo:400: 00000001:02000400:2.0:1787560425.038506:0:8295:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787560425.173274:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560425.173421:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560425.180029:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815528064:0@lo:13: 00000100:00100000:0.0:1787560425.180099:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560425.184797:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815528064 00000100:00100000:1.0:1787560425.184809:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815528064 00000100:00100000:1.0:1787560425.184884:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560425.184894:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815528064:12345-0@lo:13: 00002000:00000024:1.0:1787560425.184932:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560425.185011:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815528064:12345-0@lo:13: Request processed in 118us (4912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560425.185018:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787560425.185082:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735dc00 x1874392815528064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560425.185103:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815528064:0@lo:13: 00010000:00010000:3.0:1787560426.192122:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560427.222637:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560427.730403:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560427.730435:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815528192:0@lo:13: 00000100:00100000:2.0:1787560427.730540:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560427.731185:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815528192 00000100:00100000:0.0:1787560427.731196:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815528192 00000100:00100000:0.0:1787560427.731271:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560427.731289:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815528192:12345-0@lo:13: 00002000:00000024:0.0:1787560427.731346:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560427.731407:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815528192:12345-0@lo:13: Request processed in 127us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560427.731415:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787560427.731442:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787560427.731778:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf983b80 x1874392815528192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560427.731803:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815528192:0@lo:13: 00010000:00010000:2.0:1787560428.253358:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560428.987402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560428.987450:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560428.987474:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560428.987496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560428.987526:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788242688 00000100:00100000:2.0:1787560428.987547:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788242688 00000100:00100000:2.0:1787560428.987605:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788242816 00000100:00100000:2.0:1787560428.987609:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788242816 00000100:00100000:2.0:1787560428.987633:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:2.0:1787560428.987643:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2343:x1874392788242688:12345-192.168.201.56@tcp:400: 00000100:00100000:3.0:1787560428.987790:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788242432 00000100:00100000:3.0:1787560428.987795:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788242432 00000100:00100000:3.0:1787560428.987823:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 132 00000100:00100000:3.0:1787560428.987831:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2343:x1874392788242432:12345-192.168.201.56@tcp:400: 00000100:00080000:1.0:1787560428.988075:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560428.988080:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560428.988095:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:1.0:1787560428.988104:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2343:x1874392788242816:12345-192.168.201.56@tcp:400: 00000100:00100000:2.0:1787560428.988191:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2343:x1874392788242688:12345-192.168.201.56@tcp:400: Request processed in 548us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560428.988199:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:0.0:1787560428.991695:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788242560 00000100:00100000:0.0:1787560428.991715:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788242560 00000100:00100000:0.0:1787560428.991809:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:0.0:1787560428.991821:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788242560:12345-192.168.201.56@tcp:400: 00000100:00100000:3.0:1787560428.992302:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2343:x1874392788242432:12345-192.168.201.56@tcp:400: Request processed in 4467us (4906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560428.992314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 132 00000100:00080000:1.0:1787560429.000861:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560429.000928:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2343:x1874392788242816:12345-192.168.201.56@tcp:400: Request processed in 12816us (13420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560429.000940:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:0.0:1787560429.006641:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788242560:12345-192.168.201.56@tcp:400: Request processed in 14812us (19154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560429.006656:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 29 00010000:00010000:1.0:1787560429.265162:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787560429.671665:0:8443:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7c22df60 20000000:00000080:2.0:1787560429.671683:0:8443:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d9babbec00 uarg=0000000000000000 20000000:01000000:2.0:1787560429.671718:0:8443:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787560429.671720:0:8443:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787560429.671723:0:8443:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787560429.671728:0:8443:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787560429.671733:0:8443:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787560429.671749:0:8443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787560429.671751:0:8443:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787560429.672153:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787560429.672156:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787560429.673278:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787560429.674069:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787560429.674139:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787560429.674175:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787560429.674273:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787560429.674276:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787560429.675571:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787560429.676364:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787560429.676414:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787560429.676467:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787560429.676561:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787560429.676565:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787560429.678380:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787560429.679175:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787560429.679341:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787560429.679393:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787560429.679411:0:8443:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787560429.679414:0:8443:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787560429.694815:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787560429.696083:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787560429.696147:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787560429.696391:0:8443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1787560429.696418:0:8443:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787560429.696440:0:8443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696459:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d980031a00/0xe34191b05673ee34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee2d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696467:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9829c5400/0xe34191b05673ee5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee57 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696474:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ee88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee81 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696493:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4463800/0xe34191b05673ee96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee8f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696500:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4462a00/0xe34191b05673eea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee9d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696506:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c21db000/0xe34191b05673eec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673eeb9 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696513:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c21da800/0xe34191b05673eeea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673eee3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696525:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c21da400/0xe34191b05673eef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921ac expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696533:0:8443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4463c00/0xe34191b05673eeff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921b3 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696541:0:8443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696601:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4463c00/0xe34191b05673eeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921b3 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.696617:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9b4463c00/0xe34191b05673eeff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921b3 expref: 9 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.696633:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528320:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560429.696742:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c21da400/0xe34191b05673eef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921ac expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.697734:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9c21da400/0xe34191b05673eef8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921ac expref: 9 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.697752:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528448:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560429.698377:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c21da800/0xe34191b05673eeea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673eee3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.698389:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9c21da800/0xe34191b05673eeea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673eee3 expref: 18 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.698399:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528576:0@lo:104: 00000100:00100000:3.0:1787560429.698436:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560429.698476:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c21db000/0xe34191b05673eec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673eeb9 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.698484:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9c21db000/0xe34191b05673eec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673eeb9 expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.698492:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528704:0@lo:104: 00000100:00100000:0.0:1787560429.698971:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815528576 00000100:00100000:0.0:1787560429.698979:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815528576 00000100:00100000:3.0:1787560429.699144:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560429.703463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560429.703606:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:1.0:1787560429.703695:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4462a00/0xe34191b05673eea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ee9d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560429.703711:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9b4462a00/0xe34191b05673eea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ee9d expref: 18 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.703726:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528832:0@lo:104: 00010000:00010000:1.0:1787560429.703843:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4463800/0xe34191b05673ee96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ee8f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560429.703961:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9b4463800/0xe34191b05673ee96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ee8f expref: 18 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.703970:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528960:0@lo:104: 00010000:00010000:1.0:1787560429.704000:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ee88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ee81 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560429.704009:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ee88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ee81 expref: 18 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.704017:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815529088:0@lo:104: 00000100:00100000:3.0:1787560429.704469:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788243072 00010000:00010000:1.0:1787560429.704600:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9829c5400/0xe34191b05673ee5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ee57 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560429.704610:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9829c5400/0xe34191b05673ee5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ee57 expref: 18 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.704637:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815529216:0@lo:104: 00010000:00010000:1.0:1787560429.704667:0:8443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d980031a00/0xe34191b05673ee34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ee2d expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560429.704675:0:8443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d980031a00/0xe34191b05673ee34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ee2d expref: 18 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.704683:0:8443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815529344:0@lo:104: 00000100:00100000:1.0:1787560429.704704:0:8443:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9905a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560429.704733:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528320:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560429.704744:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528448:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560429.704841:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788243072 00010000:00010000:3.0:1787560429.704911:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c21da400/0xe34191b05673eef8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921ac expref: 10 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.704940:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788242944 00000100:00100000:3.0:1787560429.704943:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788242944 00010000:00010000:3.0:1787560429.704955:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4463c00/0xe34191b05673eeff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921b3 expref: 11 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.704987:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1787560429.704995:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:194701de-fe21-4f70-a6ed-c87f3844b85e+11:2342:x1874392788243072:12345-192.168.201.56@tcp:103: 00010000:00010000:3.0:1787560429.705009:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560429.705014:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c21da400/0xe34191b05673eef8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921ac expref: 11 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.705023:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c21da400/0xe34191b05673eef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921ac expref: 11 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.705037:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21da400/0xe34191b05673eef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921ac expref: 11 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.705053:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560429.705095:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2342:x1874392788243072:12345-192.168.201.56@tcp:103: Request processed in 100us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560429.705101:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1787560429.705117:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:3.0:1787560429.705123:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:194701de-fe21-4f70-a6ed-c87f3844b85e+9:2342:x1874392788242944:12345-192.168.201.56@tcp:103: 00010000:00010000:3.0:1787560429.705130:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560429.705135:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4463c00/0xe34191b05673eeff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921b3 expref: 9 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.705144:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4463c00/0xe34191b05673eeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921b3 expref: 9 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.705153:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4463c00/0xe34191b05673eeff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921b3 expref: 9 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.705167:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560429.705364:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815528704 00000100:00100000:2.0:1787560429.705370:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815528704 00000100:00100000:2.0:1787560429.705394:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560429.705401:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:8443:x1874392815528576:12345-0@lo:104: 00010000:00010000:2.0:1787560429.705413:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.705471:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560429.705488:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:8443:x1874392815528576:12345-0@lo:104: Request processed in 87us (7052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.705494:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560429.705512:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560429.705519:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baba7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:8443:x1874392815528704:12345-0@lo:104: 00010000:00010000:2.0:1787560429.705526:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.705561:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787560429.705566:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baba7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:8443:x1874392815528704:12345-0@lo:104: Request processed in 49us (6424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.705572:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560429.705613:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.705628:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.705637:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.705645:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.705653:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.705661:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815528832 00000100:00100000:2.0:1787560429.705665:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815528832 00000100:00100000:2.0:1787560429.705686:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815528960 00000100:00100000:2.0:1787560429.705689:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815528960 00000100:00100000:2.0:1787560429.705697:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815529088 00000100:00100000:2.0:1787560429.705699:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815529088 00000100:00100000:2.0:1787560429.705706:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815529216 00000100:00100000:2.0:1787560429.705708:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815529216 00000100:00100000:2.0:1787560429.705714:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815529344 00000100:00100000:2.0:1787560429.705716:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815529344 00000100:00100000:2.0:1787560429.705726:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560429.705732:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+7:8443:x1874392815528832:12345-0@lo:104: 00010000:00010000:2.0:1787560429.705739:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.705786:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787560429.705792:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+7:8443:x1874392815528832:12345-0@lo:104: Request processed in 60us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.705797:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560429.705810:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560429.705816:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+6:8443:x1874392815528960:12345-0@lo:104: 00010000:00010000:2.0:1787560429.705823:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.705879:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787560429.705884:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+6:8443:x1874392815528960:12345-0@lo:104: Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.705890:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560429.705901:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560429.705906:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:8443:x1874392815529088:12345-0@lo:104: 00010000:00010000:2.0:1787560429.705913:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.705951:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787560429.705957:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:8443:x1874392815529088:12345-0@lo:104: Request processed in 50us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.705962:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560429.705974:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560429.705980:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:8443:x1874392815529216:12345-0@lo:104: 00010000:00010000:2.0:1787560429.705986:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706009:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787560429.706014:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:8443:x1874392815529216:12345-0@lo:104: Request processed in 35us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.706019:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560429.706028:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560429.706033:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:8443:x1874392815529344:12345-0@lo:104: 00010000:00010000:2.0:1787560429.706040:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706065:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787560429.706070:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:8443:x1874392815529344:12345-0@lo:104: Request processed in 37us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.706075:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787560429.706093:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787560429.706098:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706105:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db400 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560429.706114:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706122:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560429.706129:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560429.706135:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560429.706162:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706168:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560429.706183:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706202:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21db400/0xe34191b05673eee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673eeea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706214:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787560429.706218:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706223:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dbc00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560429.706226:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706232:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560429.706247:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560429.706253:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560429.706277:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706283:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560429.706296:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706303:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673eeb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673eec0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706312:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787560429.706315:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706321:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4462e00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560429.706324:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706330:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560429.706336:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560429.706341:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560429.706359:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706364:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560429.706369:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706375:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9b4462e00/0xe34191b05673ee9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673eea4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706384:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787560429.706387:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706392:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c5e00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560429.706395:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706401:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560429.706407:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560429.706412:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560429.706424:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706429:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560429.706434:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706450:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9829c5e00/0xe34191b05673ee8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee96 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706460:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787560429.706463:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706469:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4462800 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560429.706471:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706478:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560429.706483:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560429.706488:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560429.706501:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706507:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560429.706511:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706517:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9b4462800/0xe34191b05673ee81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706525:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560429.706532:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706538:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da600 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560429.706541:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706547:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560429.706553:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560429.706558:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560429.706584:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706590:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560429.706595:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706601:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b05673ee57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee5e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706609:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560429.706611:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706617:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4462200 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560429.706620:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706637:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560429.706643:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560429.706648:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560429.706662:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706668:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560429.706672:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706678:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ee2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee34 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560429.706691:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560429.706693:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560429.706694:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560429.706702:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560429.706708:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560429.706729:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815529472:0@lo:103: 00000100:00100000:2.0:1787560429.706765:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.706788:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815529984:0@lo:103: 00000100:00100000:2.0:1787560429.706808:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.706823:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560429.706828:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815529856:0@lo:103: 00000100:00100000:2.0:1787560429.706881:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.706902:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815529728:0@lo:103: 00000100:00100000:2.0:1787560429.706921:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.706930:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815530240:0@lo:103: 00000100:00100000:2.0:1787560429.706948:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.706958:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787560429.706962:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815529600:0@lo:103: 00000100:00100000:2.0:1787560429.706978:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.706987:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815530112:0@lo:103: 00000100:00100000:2.0:1787560429.707003:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560429.707394:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:194701de-fe21-4f70-a6ed-c87f3844b85e+8:2342:x1874392788242944:12345-192.168.201.56@tcp:103: Request processed in 64us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560429.707405:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:3.0:1787560429.707428:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815529472 00000100:00100000:3.0:1787560429.707434:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815529472 00010000:00010000:3.0:1787560429.707457:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c21da800/0xe34191b05673eeea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673eee3 expref: 19 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.707473:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815529984 00000100:00100000:3.0:1787560429.707476:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815529984 00010000:00010000:3.0:1787560429.707485:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ee88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee81 expref: 20 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.707494:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815529856 00000100:00100000:3.0:1787560429.707496:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815529856 00010000:00010000:3.0:1787560429.707505:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4463800/0xe34191b05673ee96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee8f expref: 21 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.707514:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815529728 00000100:00100000:3.0:1787560429.707517:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815529728 00010000:00010000:3.0:1787560429.707526:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4462a00/0xe34191b05673eea4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee9d expref: 22 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.707536:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815530240 00000100:00100000:3.0:1787560429.707538:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815530240 00010000:00010000:3.0:1787560429.707547:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d980031a00/0xe34191b05673ee34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee2d expref: 23 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.707556:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815529600 00000100:00100000:3.0:1787560429.707566:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815529600 00010000:00010000:3.0:1787560429.707580:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c21db000/0xe34191b05673eec0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673eeb9 expref: 24 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.707591:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815530112 00000100:00100000:3.0:1787560429.707593:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815530112 00010000:00010000:3.0:1787560429.707602:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9829c5400/0xe34191b05673ee5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee57 expref: 25 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560429.707613:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787560429.707620:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+25:3312:x1874392815529472:12345-0@lo:103: 00010000:00010000:3.0:1787560429.707631:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560429.707635:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c21da800/0xe34191b05673eeea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673eee3 expref: 25 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.707644:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c21da800/0xe34191b05673eeea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673eee3 expref: 25 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.707661:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560429.707706:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+25:3312:x1874392815529472:12345-0@lo:103: Request processed in 86us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560429.707712:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787560429.707725:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787560429.707731:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+24:3312:x1874392815529984:12345-0@lo:103: 00010000:00010000:3.0:1787560429.707738:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560429.707741:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ee88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee81 expref: 24 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.707749:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ee88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ee81 expref: 24 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.707781:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560429.707806:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+24:3312:x1874392815529984:12345-0@lo:103: Request processed in 75us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560429.707812:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787560429.707824:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787560429.707830:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+23:3312:x1874392815529856:12345-0@lo:103: 00010000:00010000:3.0:1787560429.707837:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560429.707842:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4463800/0xe34191b05673ee96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee8f expref: 23 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.707878:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4463800/0xe34191b05673ee96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ee8f expref: 23 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.707888:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560429.707909:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+23:3312:x1874392815529856:12345-0@lo:103: Request processed in 79us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560429.707914:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787560429.707925:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560429.707930:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+22:3314:x1874392815529728:12345-0@lo:103: 00010000:00010000:3.0:1787560429.707937:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560429.707942:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4462a00/0xe34191b05673eea4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee9d expref: 22 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.707950:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4462a00/0xe34191b05673eea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ee9d expref: 22 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.707959:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560429.707997:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+22:3314:x1874392815529728:12345-0@lo:103: Request processed in 67us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560429.708003:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560429.708016:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560429.708021:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+21:3314:x1874392815530240:12345-0@lo:103: 00010000:00010000:3.0:1787560429.708029:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560429.708033:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d980031a00/0xe34191b05673ee34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee2d expref: 21 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708041:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d980031a00/0xe34191b05673ee34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ee2d expref: 21 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708051:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560429.708072:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+21:3314:x1874392815530240:12345-0@lo:103: Request processed in 51us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560429.708078:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560429.708108:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787560429.708114:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+20:3314:x1874392815529600:12345-0@lo:103: 00010000:00010000:3.0:1787560429.708121:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560429.708125:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c21db000/0xe34191b05673eec0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673eeb9 expref: 20 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708133:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c21db000/0xe34191b05673eec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673eeb9 expref: 20 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708142:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560429.708164:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+20:3314:x1874392815529600:12345-0@lo:103: Request processed in 50us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560429.708170:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787560429.708418:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787560429.708426:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815530112:12345-0@lo:103: 00010000:00010000:3.0:1787560429.708434:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560429.708438:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9829c5400/0xe34191b05673ee5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee57 expref: 19 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708446:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9829c5400/0xe34191b05673ee5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ee57 expref: 19 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708458:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708466:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708480:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708487:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708493:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708500:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708505:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c4400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560429.708510:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708518:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708535:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560429.708544:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560429.708569:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815530112:12345-0@lo:103: Request processed in 145us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560429.708575:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787560429.708651:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815529600:0@lo:103: 00000100:00100000:3.0:1787560429.708660:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815530112:0@lo:103: 00000100:00100000:3.0:1787560429.708667:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815529728:0@lo:103: 00000100:00100000:3.0:1787560429.708673:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815530240:0@lo:103: 00000100:00100000:2.0:1787560429.709031:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815529856:0@lo:103: 00000100:00100000:2.0:1787560429.709041:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815529472:0@lo:103: 00000100:00100000:2.0:1787560429.709049:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815529984:0@lo:103: 00000100:00100000:1.0:1787560429.709431:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00010000:00010000:1.0:1787560429.709534:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21da800/0xe34191b05673eeea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673eee3 expref: 18 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.709547:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528576:0@lo:104: 00010000:00010000:1.0:1787560429.709560:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21db000/0xe34191b05673eec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673eeb9 expref: 17 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.709569:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528704:0@lo:104: 00010000:00010000:1.0:1787560429.709578:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4462a00/0xe34191b05673eea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ee9d expref: 16 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.709586:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528832:0@lo:104: 00010000:00010000:1.0:1787560429.709595:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4463800/0xe34191b05673ee96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ee8f expref: 15 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.709617:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815528960:0@lo:104: 00010000:00010000:1.0:1787560429.709629:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c4a00/0xe34191b05673ee88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ee81 expref: 14 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.709636:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815529088:0@lo:104: 00010000:00010000:1.0:1787560429.709644:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c5400/0xe34191b05673ee5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ee57 expref: 13 pid: 5832 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.709652:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815529216:0@lo:104: 00010000:00010000:1.0:1787560429.709659:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980031a00/0xe34191b05673ee34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ee2d expref: 12 pid: 5833 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560429.709667:0:8443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8443:1874392815529344:0@lo:104: 00010000:00010000:1.0:1787560429.709699:0:8443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560429.709707:0:8443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560429.709713:0:8443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560429.709719:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c4400/0xe34191b05673ef37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560429.777918:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815530368:0@lo:400: 00000100:00100000:2.0:1787560429.777982:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.778027:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815530880:0@lo:400: 00000100:00100000:2.0:1787560429.778049:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.778074:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560429.778079:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815530496:0@lo:400: 00000100:00100000:2.0:1787560429.778097:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.778121:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815530624:0@lo:400: 00000100:00100000:2.0:1787560429.778140:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.778155:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560429.778160:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815530752:0@lo:400: 00000100:00100000:2.0:1787560429.778192:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560429.778224:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815530368 00000100:00100000:2.0:1787560429.778231:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815530368 00000100:00100000:2.0:1787560429.778283:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815530496 00000100:00100000:2.0:1787560429.778286:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815530496 00000100:00100000:2.0:1787560429.778304:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815530752 00000100:00100000:2.0:1787560429.778306:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815530752 00000100:00100000:2.0:1787560429.778320:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560429.778328:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815530368:12345-0@lo:400: 00000100:00100000:2.0:1787560429.778375:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815530368:12345-0@lo:400: Request processed in 47us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.778381:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560429.778399:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560429.778405:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815530496:12345-0@lo:400: 00000100:00100000:2.0:1787560429.778431:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815530496:12345-0@lo:400: Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.778436:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560429.778447:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560429.778453:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815530752:12345-0@lo:400: 00000100:00100000:2.0:1787560429.778498:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815530752:12345-0@lo:400: Request processed in 45us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.778504:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560429.778534:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815530880 00000100:00100000:2.0:1787560429.778538:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815530880 00000100:00100000:2.0:1787560429.778575:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815530624 00000100:00100000:2.0:1787560429.778578:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815530624 00000100:00100000:2.0:1787560429.778609:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560429.778615:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815530880:12345-0@lo:400: 00000100:00100000:2.0:1787560429.778652:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815530880:12345-0@lo:400: Request processed in 37us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.778658:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560429.778669:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560429.778675:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815530624:12345-0@lo:400: 00000100:00100000:2.0:1787560429.778699:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815530624:12345-0@lo:400: Request processed in 25us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560429.778705:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560429.778749:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815530752:0@lo:400: 00010000:00080000:2.0:1787560429.778762:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf9c4a80 x1874392815530624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560429.778772:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815530624:0@lo:400: 00000100:00100000:2.0:1787560429.778801:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815530496:0@lo:400: 00000100:00100000:2.0:1787560429.778810:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815530368:0@lo:400: 00010000:00080000:2.0:1787560429.778820:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf9c5880 x1874392815530880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560429.778828:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815530880:0@lo:400: 00000100:00080000:1.0:1787560429.779319:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560429.779324:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560429.779327:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560430.291072:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815531008:0@lo:13: 00000100:00100000:3.0:1787560430.291154:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560430.291280:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815531008 00000100:00100000:1.0:1787560430.291289:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815531008 00000100:00100000:1.0:1787560430.291430:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787560430.291440:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815531008:12345-0@lo:13: 00002000:00000024:1.0:1787560430.291475:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560430.291521:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815531008:12345-0@lo:13: Request processed in 82us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560430.291528:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787560430.291607:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1787560430.292064:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98641f800 x1874392815531008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560430.292085:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815531008:0@lo:13: 00000100:00100000:2.0:1787560430.838803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560430.838908:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788243200 00000100:00100000:1.0:1787560430.838920:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788243200 00000100:00100000:1.0:1787560430.838985:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 133 00000100:00100000:1.0:1787560430.838995:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+8:5587:x1874392788243200:12345-192.168.201.56@tcp:101: 00010000:00010000:1.0:1787560430.839011:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560430.839031:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21db000/0xe34191b05673ef3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92215 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560430.839058:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21db000/0xe34191b05673ef3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92215 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560430.839070:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21db000/0xe34191b05673ef3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92215 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560430.839079:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db000, rc 0) 00000100:00100000:1.0:1787560430.839144:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5587:x1874392788243200:12345-192.168.201.56@tcp:101: Request processed in 150us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560430.839152:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 133 00000100:00100000:3.0:1787560430.844726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560430.844923:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788243328 00000100:00100000:2.0:1787560430.844933:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788243328 00000100:00100000:2.0:1787560430.844994:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 134 00000100:00100000:2.0:1787560430.845005:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5587:x1874392788243328:12345-192.168.201.56@tcp:501: 00000100:00100000:2.0:1787560430.845343:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5587:x1874392788243328:12345-192.168.201.56@tcp:501: Request processed in 339us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560430.845359:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 134 00000100:00100000:0.0:1787560430.852726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560430.852836:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788243456 00000100:00100000:2.0:1787560430.852873:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788243456 00000100:00100000:2.0:1787560430.852936:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 135 00000100:00100000:2.0:1787560430.852947:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5587:x1874392788243456:12345-192.168.201.56@tcp:503: 00000100:00100000:2.0:1787560430.853190:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5587:x1874392788243456:12345-192.168.201.56@tcp:503: Request processed in 245us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560430.853200:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 135 00000100:00100000:3.0:1787560430.874029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560430.874128:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788243584 00000100:00100000:1.0:1787560430.874139:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788243584 00000100:00100000:1.0:1787560430.874198:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 136 00000100:00100000:1.0:1787560430.874226:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+9:6054:x1874392788243584:12345-192.168.201.56@tcp:502: 00000100:00100000:1.0:1787560430.874547:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+9:6054:x1874392788243584:12345-192.168.201.56@tcp:502: Request processed in 316us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560430.874556:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 136 00000100:00100000:0.0:1787560430.886462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560430.886647:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788243712 00000100:00100000:3.0:1787560430.886657:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788243712 00000100:00100000:3.0:1787560430.886758:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:3.0:1787560430.886768:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+9:6054:x1874392788243712:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560430.887092:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+9:6054:x1874392788243712:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 324us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560430.887101:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:0.0:1787560430.892817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560430.893079:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788243840 00000100:00100000:2.0:1787560430.893090:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788243840 00000100:00100000:2.0:1787560430.893152:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:2.0:1787560430.893162:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5587:x1874392788243840:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560430.893177:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560430.893193:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4462e00/0xe34191b05673ef45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9221c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560430.893221:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4462e00/0xe34191b05673ef45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9221c expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560430.893231:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4462e00/0xe34191b05673ef45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9221c expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560430.893383:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4462e00, rc 0) 00000100:00100000:2.0:1787560430.893478:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5587:x1874392788243840:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 317us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560430.893485:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:2.0:1787560430.896152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560430.899142:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788243968 00000100:00100000:3.0:1787560430.899157:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788243968 00000100:00100000:3.0:1787560430.899244:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 139 00000100:00100000:3.0:1787560430.899314:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5587:x1874392788243968:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560430.900791:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5587:x1874392788243968:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 1529us (4641us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560430.900805:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 139 00010000:00010000:0.0:1787560431.314572:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787560431.443308:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787560431.443315:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d9bfc6d000 from 39 10000000:01000000:1.0:1787560431.443321:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787560431.443366:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.443379:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.443391:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560431.443414:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815531136:0@lo:101: 00000100:00100000:1.0:1787560431.443483:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.443531:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560431.443934:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815531136 00000100:00100000:3.0:1787560431.443943:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815531136 00000100:00100000:3.0:1787560431.443999:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787560431.444008:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+12:5836:x1874392815531136:12345-0@lo:101: 00010000:00010000:3.0:1787560431.444021:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560431.444035:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9829c5000/0xe34191b05673ef53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ef4c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.444059:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9829c5000/0xe34191b05673ef53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ef4c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.444069:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9829c5000/0xe34191b05673ef53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ef4c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.444079:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9829c5000, rc 0) 00000100:00100000:3.0:1787560431.444148:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815531136:12345-0@lo:101: Request processed in 141us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.444154:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787560431.444275:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815531136:0@lo:101: 00010000:00010000:0.0:1787560431.444291:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.444300:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560431.444355:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf980000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815531264:0@lo:501: 00000100:00100000:0.0:1787560431.444384:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560431.444416:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560431.444461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815531264 00000100:00100000:3.0:1787560431.444465:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815531264 00000100:00100000:3.0:1787560431.444494:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787560431.444502:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815531264:12345-0@lo:501: 00000100:00100000:3.0:1787560431.444761:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815531264:12345-0@lo:501: Request processed in 259us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.444775:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787560431.444812:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf980000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815531264:0@lo:501: 00000100:00100000:1.0:1787560431.444844:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815531392:0@lo:503: 00000100:00100000:1.0:1787560431.444920:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.444942:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560431.444977:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815531392 00000100:00100000:0.0:1787560431.444983:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815531392 00000100:00100000:0.0:1787560431.445011:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787560431.445018:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815531392:12345-0@lo:503: 00000100:00100000:0.0:1787560431.445168:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815531392:12345-0@lo:503: Request processed in 149us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560431.445175:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787560431.445198:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815531392:0@lo:503: 00000100:00100000:1.0:1787560431.445803:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8471:1874392815531520:0@lo:502: 00000100:00100000:1.0:1787560431.445875:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.445924:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.447924:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815531520 00000100:00100000:1.0:1787560431.447937:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815531520 00000100:00100000:1.0:1787560431.448002:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787560431.448014:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:8471:x1874392815531520:12345-0@lo:502: 00000100:00100000:1.0:1787560431.448416:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:8471:x1874392815531520:12345-0@lo:502: Request processed in 402us (2540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.448424:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787560431.448495:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8471:1874392815531520:0@lo:502: 00000100:00100000:1.0:1787560431.448562:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8471:1874392815531648:0@lo:502: 00000100:00100000:1.0:1787560431.448607:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.448635:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815531648 00000100:00100000:1.0:1787560431.448638:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815531648 00000100:00100000:1.0:1787560431.448662:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787560431.448670:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:8471:x1874392815531648:12345-0@lo:502: 00000100:00100000:1.0:1787560431.448917:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:8471:x1874392815531648:12345-0@lo:502: Request processed in 246us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.448924:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787560431.448978:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.448993:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8471:1874392815531648:0@lo:502: 00000040:00080000:1.0:1787560431.449017:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787560431.449094:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787560431.449121:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787560431.449131:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.449142:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560431.449157:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787560431.449160:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787560431.449163:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787560431.449187:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.449195:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.449204:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560431.449216:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815531776:0@lo:101: 00000100:00100000:1.0:1787560431.449253:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.449270:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.449282:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815531776 00000100:00100000:1.0:1787560431.449286:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815531776 00000100:00100000:1.0:1787560431.449303:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787560431.449308:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+13:5836:x1874392815531776:12345-0@lo:101: 00010000:00010000:1.0:1787560431.449316:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560431.449327:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21da600/0xe34191b05673ef61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ef5a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.449347:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21da600/0xe34191b05673ef61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ef5a expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.449357:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21da600/0xe34191b05673ef61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ef5a expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.449376:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21da600, rc 0) 00000100:00100000:1.0:1787560431.449410:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815531776:12345-0@lo:101: Request processed in 100us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.449416:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787560431.449448:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815531776:0@lo:101: 00010000:00010000:1.0:1787560431.449463:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.449471:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560431.449515:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815531904:0@lo:501: 00000100:00100000:1.0:1787560431.449542:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.449557:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.449570:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815531904 00000100:00100000:1.0:1787560431.449573:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815531904 00000100:00100000:1.0:1787560431.449591:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787560431.449597:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815531904:12345-0@lo:501: 00000100:00100000:1.0:1787560431.449814:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815531904:12345-0@lo:501: Request processed in 217us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.449820:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787560431.449869:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815531904:0@lo:501: 00000100:00100000:1.0:1787560431.449894:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815532032:0@lo:503: 00000100:00100000:1.0:1787560431.449925:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.449942:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79b480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.449956:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815532032 00000100:00100000:1.0:1787560431.449960:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815532032 00000100:00100000:1.0:1787560431.449974:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787560431.449979:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815532032:12345-0@lo:503: 00000100:00100000:1.0:1787560431.450092:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815532032:12345-0@lo:503: Request processed in 111us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.450098:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787560431.450125:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815532032:0@lo:503: 00000100:00100000:2.0:1787560431.457680:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8472:1874392815532160:0@lo:502: 00000100:00100000:2.0:1787560431.457765:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.457818:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9989d0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.459281:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815532160 00000100:00100000:1.0:1787560431.459294:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815532160 00000100:00100000:1.0:1787560431.459357:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787560431.459367:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:8472:x1874392815532160:12345-0@lo:502: 00000100:00100000:1.0:1787560431.459646:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:8472:x1874392815532160:12345-0@lo:502: Request processed in 279us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.459654:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787560431.460932:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8472:1874392815532160:0@lo:502: 00000020:01000000:3.0:1787560431.460973:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560431.460982:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560431.460985:0:8472:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787560431.460991:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787560431.461029:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8472:1874392815532288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560431.461090:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560431.461136:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815532288 00000100:00100000:3.0:1787560431.461142:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815532288 00000100:00100000:3.0:1787560431.461179:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787560431.461187:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:8472:x1874392815532288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560431.461391:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:8472:x1874392815532288:12345-0@lo:502:llog_process_th.0 Request processed in 204us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.461399:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787560431.461443:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9867846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560431.461456:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8472:1874392815532288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787560431.461475:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560431.461480:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560431.461482:0:8472:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787560431.461485:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787560431.466580:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787560431.466617:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787560431.466630:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.466642:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560431.466653:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787560431.466656:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d986ace800 from 39 10000000:01000000:1.0:1787560431.466679:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787560431.466722:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.466741:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.466753:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560431.466780:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815532416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560431.466875:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.466915:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.467818:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815532416 00000100:00100000:1.0:1787560431.467828:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815532416 00000100:00100000:1.0:1787560431.467912:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787560431.467923:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:5836:x1874392815532416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560431.467939:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560431.467956:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21db400/0xe34191b05673ef6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ef68 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.467980:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21db400/0xe34191b05673ef6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ef68 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.467990:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21db400/0xe34191b05673ef6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ef68 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.467998:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db400, rc 0) 00000100:00100000:1.0:1787560431.468051:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815532416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.468057:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787560431.468120:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815532416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560431.468135:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.468144:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560431.468197:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815532544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560431.468223:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.468261:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.468272:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815532544 00000100:00100000:1.0:1787560431.468275:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815532544 00000100:00100000:1.0:1787560431.468294:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787560431.468301:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815532544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560431.468552:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815532544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.468559:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787560431.468588:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815532544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560431.468615:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815532672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560431.468652:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.468665:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.468677:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815532672 00000100:00100000:1.0:1787560431.468681:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815532672 00000100:00100000:1.0:1787560431.468703:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787560431.468708:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815532672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560431.468843:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815532672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.468883:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787560431.468921:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815532672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560431.479078:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8473:1874392815532800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560431.479176:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560431.479218:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9867846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560431.479331:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815532800 00000100:00100000:2.0:1787560431.479338:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815532800 00000100:00100000:2.0:1787560431.479387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787560431.479396:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98328b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:8473:x1874392815532800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560431.479626:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98328b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:8473:x1874392815532800:12345-0@lo:502:llog_process_th.0 Request processed in 230us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.479634:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787560431.479719:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8473:1874392815532800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560431.479776:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8473:1874392815532928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560431.479807:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560431.479831:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9867846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560431.479908:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815532928 00000100:00100000:2.0:1787560431.479912:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815532928 00000100:00100000:2.0:1787560431.479942:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787560431.479949:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:8473:x1874392815532928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560431.480073:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:8473:x1874392815532928:12345-0@lo:502:llog_process_th.0 Request processed in 124us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.480079:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787560431.480212:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8473:1874392815532928:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787560431.480252:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787560431.480423:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787560431.480444:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787560431.480454:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.480464:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560431.480473:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787560431.480482:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787560431.480485:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787560431.480511:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.480519:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.480528:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560431.480542:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.480569:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.480587:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9989d0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560431.480600:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815533056 00000100:00100000:2.0:1787560431.480603:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815533056 00000100:00100000:2.0:1787560431.480625:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787560431.480631:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:5836:x1874392815533056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560431.480640:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560431.480653:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4462800/0xe34191b05673ef7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ef76 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.480674:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4462800/0xe34191b05673ef7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ef76 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.480684:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4462800/0xe34191b05673ef7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ef76 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.480692:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4462800, rc 0) 00000100:00100000:2.0:1787560431.480719:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815533056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.480731:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787560431.480763:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560431.480775:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.480784:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560431.480827:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.480874:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.480886:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9989d0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560431.481013:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815533184 00000100:00100000:3.0:1787560431.481018:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815533184 00000100:00100000:3.0:1787560431.481049:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787560431.481057:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815533184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560431.481296:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815533184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.481304:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787560431.481370:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.481398:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.481438:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.481461:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9989d0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560431.481498:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815533312 00000100:00100000:3.0:1787560431.481502:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815533312 00000100:00100000:3.0:1787560431.481532:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787560431.481539:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815533312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560431.481670:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815533312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.481677:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787560431.482727:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.487414:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8475:1874392815533440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560431.487502:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.487554:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbde40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560431.487613:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815533440 00000100:00100000:3.0:1787560431.487622:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815533440 00000100:00100000:3.0:1787560431.487680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787560431.487690:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:8475:x1874392815533440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560431.487946:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:8475:x1874392815533440:12345-0@lo:502:llog_process_th.0 Request processed in 257us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.487965:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787560431.491498:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8475:1874392815533440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560431.491547:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560431.491557:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560431.491559:0:8475:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787560431.491564:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787560431.491609:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8475:1874392815533568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560431.491690:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.491730:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbde40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560431.491831:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815533568 00000100:00100000:3.0:1787560431.491838:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815533568 00000100:00100000:3.0:1787560431.491918:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787560431.491928:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:8475:x1874392815533568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560431.492152:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:8475:x1874392815533568:12345-0@lo:502:llog_process_th.0 Request processed in 225us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.492160:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787560431.500810:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8475:1874392815533568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560431.500877:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560431.500886:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560431.500888:0:8475:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787560431.500893:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787560431.501098:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787560431.501121:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787560431.501131:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.501142:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560431.501152:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787560431.501154:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d982bfc800 from 39 10000000:01000000:2.0:1787560431.501158:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560431.501190:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.501198:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.501209:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560431.501238:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.501303:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.501347:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.502139:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815533696 00000100:00100000:1.0:1787560431.502148:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815533696 00000100:00100000:1.0:1787560431.502200:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787560431.502211:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815533696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560431.502233:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560431.502249:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21da400/0xe34191b05673ef8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ef84 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.502273:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21da400/0xe34191b05673ef8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ef84 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.502283:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21da400/0xe34191b05673ef8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ef84 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.502291:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21da400, rc 0) 00000100:00100000:1.0:1787560431.502339:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815533696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.502346:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787560431.502457:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560431.502471:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.502496:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560431.502552:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.502581:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.502615:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560431.502678:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815533824 00000100:00100000:3.0:1787560431.502683:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815533824 00000100:00100000:3.0:1787560431.502717:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787560431.502727:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815533824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560431.503040:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815533824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.503048:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787560431.503217:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.503257:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.503295:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.503322:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560431.503390:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815533952 00000100:00100000:1.0:1787560431.503395:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815533952 00000100:00100000:1.0:1787560431.503420:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787560431.503426:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815533952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560431.503563:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815533952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560431.503570:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787560431.503643:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815533952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560431.507126:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8478:1874392815534080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560431.507212:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.507263:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560431.507355:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815534080 00000100:00100000:3.0:1787560431.507362:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815534080 00000100:00100000:3.0:1787560431.507403:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787560431.507413:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:8478:x1874392815534080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560431.507647:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:8478:x1874392815534080:12345-0@lo:502:llog_process_th.0 Request processed in 234us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.507656:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787560431.508105:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8478:1874392815534080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560431.508158:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8478:1874392815534208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560431.508195:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560431.508223:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560431.508317:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815534208 00000100:00100000:3.0:1787560431.508322:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815534208 00000100:00100000:3.0:1787560431.508355:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787560431.508362:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:8478:x1874392815534208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560431.508528:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:8478:x1874392815534208:12345-0@lo:502:llog_process_th.0 Request processed in 166us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.508535:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787560431.508602:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8478:1874392815534208:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787560431.508622:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787560431.508963:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787560431.508983:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787560431.508993:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.509004:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560431.509015:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787560431.509019:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787560431.509022:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787560431.509051:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.509060:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.509069:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560431.509083:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815534336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560431.509118:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560431.509140:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560431.509191:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815534336 00000100:00100000:2.0:1787560431.509196:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815534336 00000100:00100000:2.0:1787560431.509236:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787560431.509244:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815534336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560431.509253:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560431.509264:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4463800/0xe34191b05673ef99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ef92 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.509285:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4463800/0xe34191b05673ef99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ef92 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.509295:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4463800/0xe34191b05673ef99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ef92 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.509317:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463800, rc 0) 00000100:00100000:2.0:1787560431.509353:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815534336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.509360:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787560431.509397:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815534336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560431.509409:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.509417:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560431.509460:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815534464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.509487:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.509500:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560431.509511:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815534464 00000100:00100000:2.0:1787560431.509515:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815534464 00000100:00100000:2.0:1787560431.509543:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787560431.509550:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815534464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.509813:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815534464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.509820:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787560431.509881:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815534464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.509909:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815534592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.509945:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.509965:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560431.509977:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815534592 00000100:00100000:2.0:1787560431.509981:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815534592 00000100:00100000:2.0:1787560431.509998:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787560431.510004:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815534592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.510134:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815534592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.510140:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787560431.510176:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815534592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.510389:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8479:1874392815534720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560431.510423:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.510442:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815534720 00000100:00100000:2.0:1787560431.510446:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815534720 00000100:00100000:2.0:1787560431.510464:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787560431.510470:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:8479:x1874392815534720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560431.510608:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:8479:x1874392815534720:12345-0@lo:502:llog_process_th.0 Request processed in 137us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.510615:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787560431.510643:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98739b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560431.510655:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8479:1874392815534720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560431.510675:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560431.510683:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560431.510685:0:8479:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787560431.510689:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787560431.510707:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8479:1874392815534848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560431.510736:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.510760:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815534848 00000100:00100000:2.0:1787560431.510764:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815534848 00000100:00100000:2.0:1787560431.510780:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787560431.510786:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:8479:x1874392815534848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560431.510923:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:8479:x1874392815534848:12345-0@lo:502:llog_process_th.0 Request processed in 136us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.510929:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787560431.510956:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98739b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560431.510969:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8479:1874392815534848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560431.510988:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560431.510992:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560431.510994:0:8479:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787560431.510998:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787560431.511043:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787560431.511057:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787560431.511066:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.511075:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560431.511084:0:5836:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787560431.511086:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d9901ecd28 from 1 10000000:01000000:2.0:1787560431.511089:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787560431.511109:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462a00/0xe34191b05673efa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.511117:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4462a00/0xe34191b05673efa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.511136:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4462a00/0xe34191b05673efa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560431.511150:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815534976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.511175:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.511188:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98739b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560431.511199:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815534976 00000100:00100000:2.0:1787560431.511202:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815534976 00000100:00100000:2.0:1787560431.511219:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787560431.511238:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815534976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560431.511247:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560431.511259:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4463c00/0xe34191b05673efa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673efa0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.511278:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4463c00/0xe34191b05673efa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673efa0 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.511288:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4463c00/0xe34191b05673efa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673efa0 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.511296:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463c00, rc 0) 00000100:00100000:2.0:1787560431.511325:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815534976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.511331:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787560431.511359:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815534976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560431.511371:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4462a00/0xe34191b05673efa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efa7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.511385:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462a00/0xe34191b05673efa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673efa7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560431.511422:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815535104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.511447:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.511460:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98739b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560431.511471:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815535104 00000100:00100000:2.0:1787560431.511474:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815535104 00000100:00100000:2.0:1787560431.511490:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787560431.511496:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815535104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560431.511662:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815535104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (214us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560431.511670:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787560431.511698:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815535104:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787560431.511716:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787560431.511721:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462a00/0xe34191b05673efa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efa7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.511728:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4462a00/0xe34191b05673efa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efa7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787560431.859798:0:8501:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7e63cee0 20000000:00000080:0.0:1787560431.859816:0:8501:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d9baa18400 uarg=0000000000000000 20000000:01000000:0.0:1787560431.859880:0:8501:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787560431.859892:0:8501:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787560431.859897:0:8501:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787560431.865296:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787560431.869842:0:8501:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787560431.876808:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787560431.876947:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787560431.877079:0:8501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787560431.877096:0:8501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787560431.877115:0:8501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.877198:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9829c5a00/0xe34191b05673ed23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed1c expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.877207:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c2044400/0xe34191b05673ed85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ed7e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.877213:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ee49 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.877231:0:8501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c21db200/0xe34191b05673ef0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921e4 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.877240:0:8501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.877282:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c21db200/0xe34191b05673ef0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921e4 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.877298:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9c21db200/0xe34191b05673ef0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921e4 expref: 9 pid: 5831 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560431.877313:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf983480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1874392815535232:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560431.877464:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ee49 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.877474:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ee49 expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560431.877484:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf980380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1874392815535360:0@lo:104: 00000100:00100000:0.0:1787560431.877525:0:8501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560431.877608:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c2044400/0xe34191b05673ed85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ed7e expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.877617:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9c2044400/0xe34191b05673ed85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ed7e expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560431.877626:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf981c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1874392815535488:0@lo:104: 00000100:00100000:0.0:1787560431.877663:0:8501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560431.883560:0:8501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9829c5a00/0xe34191b05673ed23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673ed1c expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560431.883580:0:8501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9829c5a00/0xe34191b05673ed23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673ed1c expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560431.883596:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf982d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1874392815535616:0@lo:104: 00000100:00100000:0.0:1787560431.883667:0:8501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560431.884939:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815535360 00000100:00100000:2.0:1787560431.884951:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815535360 00000100:00100000:1.0:1787560431.889199:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815535488 00000100:00100000:1.0:1787560431.889215:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815535488 00000100:00100000:2.0:1787560431.889407:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560431.889419:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:8501:x1874392815535360:12345-0@lo:104: 00010000:00010000:2.0:1787560431.889451:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.889549:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560431.889555:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:8501:x1874392815535360:12345-0@lo:104: Request processed in 140us (12031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.889563:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787560431.889873:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560431.889880:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.889888:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980031600 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560431.889891:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.889900:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560431.889918:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560431.889924:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560431.889965:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.889973:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560431.889993:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.890000:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d980031600/0xe34191b05673ee49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ee50 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.890015:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560431.890017:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560431.890019:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560431.894619:0:8501:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560431.894660:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf980380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1874392815535360:0@lo:104: 00000100:00100000:3.0:1787560431.898967:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815535616 00000100:00100000:2.0:1787560431.898978:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787560431.898981:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815535616 00000100:00100000:2.0:1787560431.899063:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baba7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:8501:x1874392815535488:12345-0@lo:104: 00010000:00010000:2.0:1787560431.899083:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560431.899099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:2.0:1787560431.899238:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560431.899245:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baba7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:8501:x1874392815535488:12345-0@lo:104: Request processed in 258us (21581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.899253:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560431.899287:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560431.899293:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:8501:x1874392815535616:12345-0@lo:104: 00000100:00100000:1.0:1787560431.899294:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf983480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1874392815535232:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560431.899300:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673ed1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560431.899304:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf981c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1874392815535488:0@lo:104: 00010000:00010000:2.0:1787560431.899349:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787560431.899354:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:8501:x1874392815535616:12345-0@lo:104: Request processed in 62us (15688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560431.899359:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560431.899391:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815535744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560431.899423:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560431.899477:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560431.899483:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.899491:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db800 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560431.899495:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.899503:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560431.899511:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560431.899516:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787560431.899547:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.899554:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560431.899568:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.899574:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21db800/0xe34191b05673ed7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.899585:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560431.899589:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673ed1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.899594:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da000 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560431.899598:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673ed1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.899610:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673ed1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560431.899616:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673ed1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560431.899621:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787560431.899622:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788244096 00000100:00100000:3.0:1787560431.899627:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788244096 00010000:00010000:2.0:1787560431.899634:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673ed1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.899648:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c21db200/0xe34191b05673ef0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921e4 expref: 10 pid: 5831 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560431.899667:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815535744 00000100:00100000:3.0:1787560431.899670:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815535744 00010000:00010000:3.0:1787560431.899682:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee49 expref: 19 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560431.899699:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:3.0:1787560431.899705:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2343:x1874392788244096:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560431.899716:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560431.899722:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c21db200/0xe34191b05673ef0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921e4 expref: 10 pid: 5831 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.899733:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c21db200/0xe34191b05673ef0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921e4 expref: 10 pid: 5831 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.899749:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21db200/0xe34191b05673ef0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921e4 expref: 10 pid: 5831 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.899763:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560431.899775:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560431.899793:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673ed1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.899800:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673ed1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673ed23 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560431.899813:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560431.899814:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560431.899816:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560431.899826:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815536000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560431.900058:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf982d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8501:1874392815535616:0@lo:104: 00010000:00010000:1.0:1787560431.900263:0:8501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560431.901125:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:194701de-fe21-4f70-a6ed-c87f3844b85e+9:2343:x1874392788244096:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 1415us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.901136:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:3.0:1787560431.901165:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560431.901174:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815535744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560431.901920:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560431.901942:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ee49 expref: 19 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.901956:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ee49 expref: 19 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.901973:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21dac00/0xe34191b05673ee50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ee49 expref: 19 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.901987:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560431.902070:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560431.902287:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815535872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560431.902371:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560431.902463:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:3313:x1874392815535744:12345-0@lo:103:ldlm_bl.0 Request processed in 1289us (3037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.902471:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560431.902498:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815536000 00000100:00100000:3.0:1787560431.902504:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815536000 00010000:00010000:3.0:1787560431.902533:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9829c5a00/0xe34191b05673ed23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ed1c expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560431.902549:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787560431.902556:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:3311:x1874392815536000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560431.902565:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560431.902569:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9829c5a00/0xe34191b05673ed23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ed1c expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.902578:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9829c5a00/0xe34191b05673ed23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ed1c expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.902588:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c5a00/0xe34191b05673ed23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ed1c expref: 18 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.902598:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560431.902642:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:3311:x1874392815536000:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.902649:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787560431.904124:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815535744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560431.904310:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815536000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560431.905070:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560431.905255:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815535872 00000100:00100000:3.0:1787560431.905262:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815535872 00010000:00010000:3.0:1787560431.905297:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c2044400/0xe34191b05673ed85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ed7e expref: 17 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560431.905334:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560431.905343:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:3314:x1874392815535872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560431.905358:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560431.905364:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c2044400/0xe34191b05673ed85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673ed7e expref: 17 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905375:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c2044400/0xe34191b05673ed85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673ed7e expref: 17 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905391:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c2044400/0xe34191b05673ed85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673ed7e expref: 17 pid: 5831 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905402:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905408:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905420:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905424:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905442:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905446:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905450:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560431.905453:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905459:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905477:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560431.905488:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560431.905587:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3314:x1874392815535872:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560431.905594:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787560431.905612:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815535872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560431.905815:0:8501:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.905825:0:8501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560431.905838:0:8501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980030600/0xe34191b05673efae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560432.337547:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560432.847027:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815536128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560432.847103:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560432.847150:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815536128 00000100:00100000:2.0:1787560432.847158:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815536128 00000100:00100000:2.0:1787560432.847238:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560432.847248:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815536128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560432.847540:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560432.847602:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815536128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 354us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560432.847610:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787560432.847625:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf980e00 x1874392815536128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560432.847644:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815536128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787560432.847949:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560433.150343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560433.150634:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788244224 00000100:00100000:2.0:1787560433.150646:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788244224 00000100:00100000:2.0:1787560433.150711:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 172 00000100:00100000:2.0:1787560433.150722:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+9:5587:x1874392788244224:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560433.150740:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560433.150763:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4463e00/0xe34191b05673efb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92223 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.150793:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4463e00/0xe34191b05673efb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92223 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.150804:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4463e00/0xe34191b05673efb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92223 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.150813:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463e00, rc 0) 00000100:00100000:0.0:1787560433.155622:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5587:x1874392788244224:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 4890us (5274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560433.155636:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 172 00000100:00100000:3.0:1787560433.169714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560433.169890:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788244352 00000100:00100000:2.0:1787560433.169902:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788244352 00000100:00100000:2.0:1787560433.169960:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 173 00000100:00100000:2.0:1787560433.169970:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5587:x1874392788244352:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560433.170348:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5587:x1874392788244352:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 378us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560433.170357:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 173 00000100:00100000:2.0:1787560433.179225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560433.179297:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788244480 00000100:00100000:3.0:1787560433.179316:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788244480 00000100:00100000:3.0:1787560433.179405:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 174 00000100:00100000:3.0:1787560433.179420:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5587:x1874392788244480:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560433.179779:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:5587:x1874392788244480:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 Request processed in 360us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560433.179790:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 174 00000100:00100000:2.0:1787560433.203613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560433.204312:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788244608 00000100:00100000:0.0:1787560433.204324:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788244608 00000100:00100000:0.0:1787560433.204436:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 175 00000100:00100000:0.0:1787560433.204462:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:6110:x1874392788244608:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560433.204717:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:6110:x1874392788244608:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 258us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560433.204726:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 175 00000100:00100000:2.0:1787560433.210465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560433.210560:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788244736 00000100:00100000:3.0:1787560433.210570:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788244736 00000100:00100000:3.0:1787560433.210720:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 176 00000100:00100000:3.0:1787560433.210732:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:6110:x1874392788244736:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560433.211349:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:6110:x1874392788244736:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 615us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560433.211360:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 176 10000000:01000000:1.0:1787560433.232222:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560433.232230:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9bfc6d000 from 4 10000000:01000000:1.0:1787560433.232236:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560433.232296:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560433.232308:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560433.232320:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560433.232346:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815536256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560433.232424:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560433.232490:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560433.232750:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815536256 00000100:00100000:0.0:1787560433.232758:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815536256 00000100:00100000:0.0:1787560433.232821:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787560433.232832:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815536256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560433.232877:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560433.232892:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d980030800/0xe34191b05673efc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673efbc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560433.232931:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980030800/0xe34191b05673efc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673efbc expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560433.232942:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d980030800/0xe34191b05673efc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673efbc expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560433.232952:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980030800, rc 0) 00000100:00100000:0.0:1787560433.232992:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815536256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560433.232999:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787560433.233364:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815536256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560433.233381:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560433.233391:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560433.234214:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815536384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560433.234259:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560433.234298:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560433.234379:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815536384 00000100:00100000:3.0:1787560433.234386:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815536384 00000100:00100000:3.0:1787560433.234422:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787560433.234431:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815536384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560433.234696:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815536384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560433.234704:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787560433.235146:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815536384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560433.235183:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815536512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560433.235234:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560433.237698:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560433.245484:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815536512 00000100:00100000:0.0:1787560433.245500:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815536512 00000100:00100000:0.0:1787560433.245579:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787560433.245593:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815536512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560433.245889:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815536512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 300us (10654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560433.245897:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787560433.246016:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815536512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560433.246660:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8534:1874392815536640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560433.246712:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560433.246752:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560433.246811:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815536640 00000100:00100000:3.0:1787560433.246827:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815536640 00000100:00100000:3.0:1787560433.246929:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787560433.246941:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:8534:x1874392815536640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560433.247276:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:8534:x1874392815536640:12345-0@lo:502:llog_process_th.0 Request processed in 336us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560433.247285:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787560433.247898:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8534:1874392815536640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560433.247944:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560433.247957:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560433.247959:0:8534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787560433.247967:0:8534:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d9bfc6d000 00000020:00000080:1.0:1787560433.247969:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787560433.248068:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8534:1874392815536768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560433.248134:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560433.248169:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98439d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560433.248459:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815536768 00000100:00100000:0.0:1787560433.248468:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815536768 00000100:00100000:0.0:1787560433.248514:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787560433.248524:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:8534:x1874392815536768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560433.248772:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:8534:x1874392815536768:12345-0@lo:502:llog_process_th.0 Request processed in 248us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560433.248781:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787560433.252935:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8534:1874392815536768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560433.252989:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560433.253002:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560433.253005:0:8534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787560433.253023:0:8534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787560433.253404:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787560433.253429:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560433.253451:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560433.253463:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560433.253474:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560433.253476:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d986ace800 from 4 10000000:01000000:1.0:1787560433.253479:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560433.253513:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560433.253522:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560433.253531:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560433.253551:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815536896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560433.253612:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560433.253655:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d982bbdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560433.253750:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815536896 00000100:00100000:2.0:1787560433.253758:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815536896 00000100:00100000:2.0:1787560433.253805:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787560433.253820:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815536896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560433.253833:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560433.253865:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4463000/0xe34191b05673efd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673efca expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.253889:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4463000/0xe34191b05673efd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673efca expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.253899:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4463000/0xe34191b05673efd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673efca expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.253907:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463000, rc 0) 00000100:00100000:2.0:1787560433.253945:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815536896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560433.253952:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787560433.253982:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815536896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560433.253993:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.254003:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560433.254059:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815537024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560433.254083:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560433.254096:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9894ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560433.254107:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815537024 00000100:00100000:2.0:1787560433.254110:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815537024 00000100:00100000:2.0:1787560433.254125:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787560433.254140:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815537024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560433.254390:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815537024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560433.254397:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787560433.254426:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815537024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560433.254466:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815537152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560433.254503:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560433.254517:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9894ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560433.254527:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815537152 00000100:00100000:2.0:1787560433.254531:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815537152 00000100:00100000:2.0:1787560433.254547:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787560433.254552:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815537152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560433.254692:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815537152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560433.254699:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787560433.254734:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815537152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560433.257356:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8536:1874392815537280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560433.257468:0:8536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560433.257515:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d991cf56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560433.257580:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815537280 00000100:00100000:1.0:1787560433.257588:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815537280 00000100:00100000:1.0:1787560433.257641:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787560433.257652:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:8536:x1874392815537280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560433.257909:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:8536:x1874392815537280:12345-0@lo:502:llog_process_th.0 Request processed in 257us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560433.257926:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787560433.258020:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8536:1874392815537280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560433.258063:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560433.258073:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560433.258076:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787560433.258082:0:8536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d986ace800 00000020:00000080:2.0:1787560433.258091:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787560433.258174:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8536:1874392815537408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560433.258223:0:8536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560433.258242:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b1d29600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560433.258912:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815537408 00000100:00100000:1.0:1787560433.258919:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815537408 00000100:00100000:1.0:1787560433.258955:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787560433.258964:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:8536:x1874392815537408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560433.259308:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:8536:x1874392815537408:12345-0@lo:502:llog_process_th.0 Request processed in 344us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560433.259315:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787560433.259428:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8536:1874392815537408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560433.259468:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560433.259476:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560433.259478:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787560433.259482:0:8536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787560433.259761:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787560433.259782:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560433.259790:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560433.259802:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560433.259812:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560433.259814:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d982bfc800 from 4 10000000:01000000:1.0:1787560433.259817:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560433.259844:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560433.259886:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560433.259895:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560433.259913:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815537536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560433.259959:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560433.259985:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560433.260383:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815537536 00000100:00100000:2.0:1787560433.260390:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815537536 00000100:00100000:2.0:1787560433.260430:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787560433.260451:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815537536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560433.260463:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560433.260480:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4463a00/0xe34191b05673efdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673efd8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.260504:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4463a00/0xe34191b05673efdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673efd8 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.260515:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4463a00/0xe34191b05673efdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673efd8 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.260525:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463a00, rc 0) 00000100:00100000:2.0:1787560433.260569:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815537536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560433.260576:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787560433.260618:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815537536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560433.260640:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.260649:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560433.260698:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815537664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560433.260729:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560433.260742:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b1d29600 going to sleep for 11 seconds 00000100:00100000:2.0:1787560433.260755:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815537664 00000100:00100000:2.0:1787560433.260759:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815537664 00000100:00100000:2.0:1787560433.260779:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787560433.260785:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815537664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560433.261760:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815537664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 968us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560433.261770:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787560433.263686:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815537664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560433.263747:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815537792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560433.263819:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560433.263876:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560433.263966:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815537792 00000100:00100000:2.0:1787560433.263973:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815537792 00000100:00100000:2.0:1787560433.264022:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787560433.264031:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815537792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560433.264256:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815537792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560433.264264:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787560433.264314:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815537792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560433.266225:0:8537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf981880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8537:1874392815537920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560433.266598:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560433.266659:0:8537:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560433.267867:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815537920 00000100:00100000:2.0:1787560433.267883:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815537920 00000100:00100000:2.0:1787560433.267977:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787560433.267989:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:8537:x1874392815537920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560433.268320:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:8537:x1874392815537920:12345-0@lo:502:llog_process_th.0 Request processed in 333us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560433.268329:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787560433.269419:0:8537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf981880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8537:1874392815537920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560433.269682:0:8537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560433.269700:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560433.269703:0:8537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787560433.269714:0:8537:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d982bfc800 00000020:00000080:0.0:1787560433.269718:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787560433.271743:0:8537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf981880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8537:1874392815538048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560433.271885:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560433.271944:0:8537:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560433.272760:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815538048 00000100:00100000:2.0:1787560433.272776:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815538048 00000100:00100000:2.0:1787560433.272829:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787560433.272840:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:8537:x1874392815538048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560433.273343:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:8537:x1874392815538048:12345-0@lo:502:llog_process_th.0 Request processed in 502us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560433.273353:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787560433.275672:0:8537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf981880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:8537:1874392815538048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560433.275747:0:8537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560433.275762:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560433.275764:0:8537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787560433.275770:0:8537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787560433.276362:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787560433.276405:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560433.276418:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560433.276431:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560433.358998:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560434.098036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560434.098084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560434.098187:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788244864 00000100:00100000:2.0:1787560434.098201:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788244864 00000100:00100000:2.0:1787560434.098270:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 192 00000100:00100000:2.0:1787560434.098282:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2345:x1874392788244864:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560434.098375:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2345:x1874392788244864:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 95us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560434.098384:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 192 00000100:00100000:0.0:1787560434.100800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560434.100842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560434.101987:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788244992 00000100:00100000:2.0:1787560434.102005:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788244992 00000100:00100000:2.0:1787560434.102112:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:2.0:1787560434.102126:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788244992:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560434.105953:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788245120 00000100:00100000:1.0:1787560434.105973:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788245120 00000100:00100000:2.0:1787560434.105985:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788245248 00000100:00100000:2.0:1787560434.105990:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788245248 00000100:00100000:2.0:1787560434.106073:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:2.0:1787560434.106086:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788245248:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560434.106325:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788245248:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 240us (5479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560434.106344:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:2.0:1787560434.106380:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:2.0:1787560434.106407:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788245120:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560434.106677:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788245120:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 288us (8590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560434.106685:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00080000:3.0:1787560434.117917:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560434.117930:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560434.117934:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560434.118037:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788244992:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 15903us (17239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560434.118074:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00010000:00010000:0.0:1787560434.390801:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560434.895068:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560434.895138:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560434.895159:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815538304:0@lo:400:kworker.0 00000100:00100000:1.0:1787560434.895243:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560434.895471:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815538304 00000100:00100000:3.0:1787560434.895485:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815538304 00000100:00100000:3.0:1787560434.895535:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787560434.895545:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815538304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560434.895607:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815538304:12345-0@lo:400:kworker.0 Request processed in 64us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560434.895614:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787560434.895778:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815538304:0@lo:400:kworker.0 00000100:00100000:0.0:1787560434.895829:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815538176:0@lo:400:kworker.0 00000100:00100000:0.0:1787560434.895897:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560434.896026:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815538176 00000100:00100000:1.0:1787560434.896030:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815538176 00000100:00100000:1.0:1787560434.896068:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787560434.896075:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815538176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560434.896117:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815538176:12345-0@lo:400:kworker.0 Request processed in 42us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560434.896124:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787560434.896241:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815538176:0@lo:400:kworker.0 00000100:00100000:0.0:1787560434.896759:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815538432:0@lo:400:kworker.0 00000100:00100000:0.0:1787560434.896805:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560434.896923:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815538560:0@lo:400:kworker.0 00000100:00100000:1.0:1787560434.896948:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560434.896972:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815538560 00000100:00100000:1.0:1787560434.896975:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815538560 00000100:00100000:1.0:1787560434.897003:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787560434.897007:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815538560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560434.897040:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815538560:12345-0@lo:400:kworker.0 Request processed in 31us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560434.897054:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787560434.897086:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf9c7b80 x1874392815538560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560434.897098:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815538560:0@lo:400:kworker.0 00000100:00100000:3.0:1787560434.897161:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815538432 00000100:00100000:3.0:1787560434.897176:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815538432 00000100:00100000:3.0:1787560434.897213:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560434.897221:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815538432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560434.897492:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815538816:0@lo:400:kworker.0 00000100:00100000:2.0:1787560434.897522:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560434.897543:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560434.897549:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815538688:0@lo:400:kworker.0 00000100:00100000:2.0:1787560434.897572:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560434.897597:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815538688 00000100:00100000:2.0:1787560434.897602:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815538688 00000100:00100000:2.0:1787560434.897626:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560434.897633:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815538688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560434.897679:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815538688:12345-0@lo:400:kworker.0 Request processed in 46us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560434.897686:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560434.897713:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815538688:0@lo:400:kworker.0 00000100:00100000:3.0:1787560434.898122:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815538432:12345-0@lo:400:kworker.0 Request processed in 901us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560434.898127:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787560434.898145:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560434.898149:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560434.898209:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815538432:0@lo:400:kworker.0 00000100:00100000:0.0:1787560434.898231:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815538816 00000100:00100000:0.0:1787560434.898235:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815538816 00000100:00100000:0.0:1787560434.898334:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787560434.898342:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815538816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560434.898396:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815538816:12345-0@lo:400:kworker.0 Request processed in 55us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560434.898402:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787560434.898498:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf9c7480 x1874392815538816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560434.898509:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815538816:0@lo:400:kworker.0 00000100:00080000:3.0:1787560434.899228:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560435.408794:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815538944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560435.408936:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560435.409077:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815538944 00000100:00100000:2.0:1787560435.409097:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815538944 00000100:00100000:3.0:1787560435.409313:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560435.409327:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815538944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560435.409377:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00010000:1.0:1787560435.409394:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560435.428862:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815538944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 19505us (19895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560435.428883:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787560435.430298:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98641ea00 x1874392815538944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560435.430331:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815538944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787560436.431135:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560437.455331:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560437.969144:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560437.969176:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815539072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560437.969272:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560437.970010:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815539072 00000100:00100000:2.0:1787560437.970021:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815539072 00000100:00100000:2.0:1787560437.970091:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560437.970105:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815539072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560437.970165:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560437.970235:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815539072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560437.970242:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787560437.970295:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf983480 x1874392815539072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560437.970321:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815539072:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560437.970601:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787560438.480424:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560439.232398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560439.232467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560439.232513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560439.232569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560439.232615:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788245376 00000100:00100000:0.0:1787560439.232629:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788245376 00000100:00100000:0.0:1787560439.232704:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 194 00000100:00100000:0.0:1787560439.232717:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2344:x1874392788245376:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560439.232816:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2344:x1874392788245376:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 102us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560439.232825:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 194 00000100:00100000:0.0:1787560439.232885:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788245760 00000100:00100000:0.0:1787560439.232889:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788245760 00000100:00100000:0.0:1787560439.232921:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788245632 00000100:00100000:0.0:1787560439.232924:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788245632 00000100:00100000:0.0:1787560439.232945:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:0.0:1787560439.232952:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788245760:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560439.232977:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788245760:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560439.232984:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:0.0:1787560439.232995:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:0.0:1787560439.233000:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788245632:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560439.233018:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788245632:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 19us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560439.233024:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00080000:3.0:1787560439.233274:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560439.233279:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560439.233970:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788245504 00000100:00100000:2.0:1787560439.233979:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788245504 00000100:00100000:2.0:1787560439.234045:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:2.0:1787560439.234055:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788245504:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560439.234129:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788245504:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 76us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560439.234137:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00080000:3.0:1787560439.234237:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787560439.511907:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787560439.872194:0:8802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1787560440.015649:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815539456:0@lo:400:kworker.0 00000100:00100000:3.0:1787560440.015747:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560440.015825:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560440.015832:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815539584:0@lo:400:kworker.0 00000100:00100000:3.0:1787560440.015887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560440.015932:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815539456 00000100:00100000:3.0:1787560440.015942:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815539456 00000100:00100000:3.0:1787560440.016013:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560440.016026:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815539456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560440.016099:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815539456:12345-0@lo:400:kworker.0 Request processed in 76us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560440.016107:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560440.016135:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815539584 00000100:00100000:3.0:1787560440.016139:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815539584 00000100:00100000:3.0:1787560440.016173:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560440.016180:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815539584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560440.016213:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815539584:12345-0@lo:400:kworker.0 Request processed in 34us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560440.016220:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787560440.016237:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560440.016243:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560440.016504:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815539328:0@lo:400:kworker.0 00000100:00100000:2.0:1787560440.016558:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560440.016581:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815539840:0@lo:400:kworker.0 00000100:00100000:2.0:1787560440.016605:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560440.016631:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787560440.016637:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815539200:0@lo:400:kworker.0 00000100:00100000:2.0:1787560440.016668:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560440.016691:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815539712:0@lo:400:kworker.0 00000100:00100000:2.0:1787560440.016714:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560440.016743:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815539328 00000100:00100000:2.0:1787560440.016747:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815539328 00000100:00100000:2.0:1787560440.016771:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815539712 00000100:00100000:2.0:1787560440.016774:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815539712 00000100:00100000:2.0:1787560440.016796:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787560440.016802:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815539328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560440.016839:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815539328:12345-0@lo:400:kworker.0 Request processed in 37us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560440.016862:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787560440.016876:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787560440.016882:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815539712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560440.016913:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815539712:12345-0@lo:400:kworker.0 Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560440.016919:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787560440.016967:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815539712:0@lo:400:kworker.0 00000100:00100000:2.0:1787560440.016979:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815539328:0@lo:400:kworker.0 00000100:00100000:0.0:1787560440.017256:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815539840 00000100:00100000:0.0:1787560440.017262:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815539840 00000100:00100000:0.0:1787560440.017312:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787560440.017327:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815539840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560440.017384:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815539840:12345-0@lo:400:kworker.0 Request processed in 56us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560440.017392:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787560440.017426:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c5f80 x1874392815539840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560440.017450:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815539840:0@lo:400:kworker.0 00000100:00100000:3.0:1787560440.020275:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815539200 00000100:00100000:3.0:1787560440.020298:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815539200 00000100:00100000:3.0:1787560440.020388:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787560440.020419:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815539200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560440.020544:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815539200:12345-0@lo:400:kworker.0 Request processed in 128us (3873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560440.020552:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1787560440.020612:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560440.020621:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787560440.020669:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c6300 x1874392815539584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560440.020690:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815539584:0@lo:400:kworker.0 00000100:00100000:3.0:1787560440.020707:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815539456:0@lo:400:kworker.0 00000100:00100000:3.0:1787560440.020933:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815539200:0@lo:400:kworker.0 00010000:00010000:0.0:1787560440.527012:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560440.527031:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815539968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560440.527323:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560440.527477:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815539968 00000100:00100000:3.0:1787560440.527484:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815539968 00000100:00100000:3.0:1787560440.527577:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787560440.527588:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815539968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560440.527625:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560440.527674:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815539968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560440.527680:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787560440.527880:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883426300 x1874392815539968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560440.527899:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815539968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787560441.551129:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560442.574996:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560443.087126:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560443.087148:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815540096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560443.087215:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560443.087289:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815540096 00000100:00100000:0.0:1787560443.087297:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815540096 00000100:00100000:0.0:1787560443.087346:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560443.087358:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815540096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560443.087388:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560443.087425:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815540096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560443.087432:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787560443.087452:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560443.087477:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883426300 x1874392815540096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560443.087493:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815540096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787560443.599974:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560444.341802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560444.341875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560444.341928:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788246016 00000100:00100000:0.0:1787560444.341937:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788246016 00000100:00100000:0.0:1787560444.341998:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00100000:0.0:1787560444.342024:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788246016:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560444.342093:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788246016:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560444.342100:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00080000:0.0:1787560444.342122:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560444.342616:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788245888 00000100:00100000:3.0:1787560444.342622:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788245888 00000100:00100000:3.0:1787560444.342653:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 196 00000100:00100000:3.0:1787560444.342661:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2345:x1874392788245888:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560444.342704:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2345:x1874392788245888:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 44us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560444.342712:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 196 00000100:00100000:3.0:1787560444.350508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560444.351143:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788246144 00000100:00100000:1.0:1787560444.351155:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788246144 00000100:00100000:1.0:1787560444.351229:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:1.0:1787560444.351240:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2341:x1874392788246144:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:1.0:1787560444.351293:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ef1b 00000100:00080000:1.0:1787560444.351313:0:6685:0:(import.c:65:import_set_state_nolock()) ffff93d881255000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787560444.351351:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787560444.351714:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+2:2341:x1874392788246144:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 475us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560444.351723:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00010000:00010000:1.0:1787560444.351781:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560444.352161:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560444.374973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560444.375032:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788246272 00000100:00100000:2.0:1787560444.375042:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788246272 00000100:00100000:2.0:1787560444.375115:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:2.0:1787560444.375126:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2341:x1874392788246272:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:2.0:1787560444.375165:0:8101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ef22 00000100:00080000:2.0:1787560444.375175:0:8101:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e2000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787560444.375200:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787560444.375218:0:8101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787560444.375622:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+2:2341:x1874392788246272:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 494us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560444.375632:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00080000:2.0:1787560444.375656:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787560444.622952:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787560445.006296:0:9046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing yml_node 00000100:00100000:0.0:1787560445.136486:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815540224:0@lo:400:kworker.0 00000100:00100000:0.0:1787560445.136579:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560445.137084:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815540224 00000100:00100000:3.0:1787560445.137093:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815540224 00000100:00100000:3.0:1787560445.137153:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787560445.137163:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815540224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560445.137488:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815540608:0@lo:400:kworker.0 00000100:00100000:1.0:1787560445.137527:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560445.137552:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560445.137558:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874392815540480:0@lo:400:kworker.0 00000100:00100000:3.0:1787560445.137625:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815540224:12345-0@lo:400:kworker.0 Request processed in 462us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560445.137633:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787560445.137669:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815540352:0@lo:400:kworker.0 00000100:00100000:3.0:1787560445.137697:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560445.137718:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815540864:0@lo:400:kworker.0 00000100:00100000:3.0:1787560445.137739:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560445.137759:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560445.137764:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815540736:0@lo:400:kworker.0 00000100:00100000:3.0:1787560445.137782:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560445.137807:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815540352 00000100:00100000:3.0:1787560445.137811:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815540352 00000100:00100000:3.0:1787560445.137839:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815540736 00000100:00100000:3.0:1787560445.137842:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815540736 00000100:00100000:3.0:1787560445.137898:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787560445.137906:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815540352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560445.137956:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815540352:12345-0@lo:400:kworker.0 Request processed in 51us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560445.137963:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787560445.137976:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787560445.137982:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815540736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560445.138020:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815540736:12345-0@lo:400:kworker.0 Request processed in 38us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560445.138026:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787560445.138047:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815540608 00000100:00100000:3.0:1787560445.138050:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815540608 00000100:00100000:3.0:1787560445.138081:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815540864 00000100:00100000:3.0:1787560445.138084:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815540864 00000100:00100000:3.0:1787560445.138103:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560445.138110:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815540608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560445.138141:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815540608:12345-0@lo:400:kworker.0 Request processed in 31us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560445.138147:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560445.138159:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787560445.138166:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815540864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560445.138193:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815540864:12345-0@lo:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560445.138199:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787560445.138221:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560445.138224:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560445.138227:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560445.138429:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815540736:0@lo:400:kworker.0 00000100:00100000:3.0:1787560445.138455:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815540352:0@lo:400:kworker.0 00010000:00080000:3.0:1787560445.138466:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d998b73480 x1874392815540864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560445.138476:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815540864:0@lo:400:kworker.0 00000100:00100000:1.0:1787560445.138693:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787560445.138729:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98641d500 x1874392815540608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560445.138740:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815540608:0@lo:400:kworker.0 00000100:00100000:2.0:1787560445.138814:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815540480 00000100:00100000:2.0:1787560445.138819:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815540480 00000100:00100000:2.0:1787560445.138882:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560445.138890:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874392815540480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560445.138928:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874392815540480:12345-0@lo:400:kworker.0 Request processed in 40us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560445.138934:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787560445.139051:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560445.139071:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874392815540480:0@lo:400:kworker.0 00000100:00100000:0.0:1787560445.139358:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815540224:0@lo:400:kworker.0 00000100:00100000:3.0:1787560445.648146:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560445.648221:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560445.648368:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815540992 00000100:00100000:3.0:1787560445.648377:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815540992 00000100:00100000:3.0:1787560445.648423:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560445.648432:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815540992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560445.648467:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560445.648512:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815540992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560445.648519:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787560445.648558:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c4000 x1874392815540992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560445.649015:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815540992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560445.649386:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560446.671191:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560447.695663:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560448.207034:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560448.207054:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815541120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560448.207128:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560448.207186:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815541120 00000100:00100000:1.0:1787560448.207195:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815541120 00000100:00100000:1.0:1787560448.207254:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787560448.207259:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560448.207266:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815541120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560448.207301:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560448.207358:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815541120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560448.207367:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787560448.207453:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883425180 x1874392815541120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560448.207477:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815541120:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787560448.264396:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:3.0:1787560448.264405:0:7642:0:(genops.c:885:class_export_put()) final put ffff93d9b38e5000/3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:0.0:1787560448.264626:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b38e5000/3e6b7760-d76b-45e8-8d98-861d14ecc789 for lustre-OST0001 00000020:00000080:0.0:1787560448.264747:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9b38e2000 for lustre-OST0001 00010000:00010000:1.0:1787560448.720711:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787560448.835897:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:0.0:1787560448.835905:0:6708:0:(genops.c:885:class_export_put()) final put ffff93d881257800/3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:3.0:1787560448.835980:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d881257800/3e6b7760-d76b-45e8-8d98-861d14ecc789 for lustre-OST0000 00000020:00000080:3.0:1787560448.837409:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d881255000 for lustre-OST0000 00000001:02000400:3.0:1787560449.093967:0:9242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.82 00000100:00100000:1.0:1787560449.457619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560449.457723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560449.457774:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788246400 00000100:00100000:1.0:1787560449.457784:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788246400 00000100:00100000:1.0:1787560449.457868:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 198 00000100:00100000:1.0:1787560449.457880:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2344:x1874392788246400:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560449.457984:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2344:x1874392788246400:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 105us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560449.457992:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 198 00000100:00100000:0.0:1787560449.459547:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788246528 00000100:00100000:0.0:1787560449.459557:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788246528 00000100:00100000:0.0:1787560449.459624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:0.0:1787560449.459634:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788246528:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560449.459698:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788246528:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 66us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560449.459705:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00080000:1.0:1787560449.459904:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787560449.745808:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560450.255218:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815541248:0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.255298:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560450.255364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815541248 00000100:00100000:3.0:1787560450.255387:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815541248 00000100:00100000:3.0:1787560450.255450:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787560450.255462:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815541248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560450.255514:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815541248:12345-0@lo:400:kworker.0 Request processed in 54us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560450.255522:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787560450.255531:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815541376:0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.255569:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560450.255602:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815541888:0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.255626:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560450.255656:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560450.255662:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815541760:0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.255684:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560450.255711:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815541504:0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.255748:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560450.255771:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560450.255777:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815541632:0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.255801:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560450.255833:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815541376 00000100:00100000:1.0:1787560450.255835:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815541760 00000100:00100000:2.0:1787560450.255839:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815541376 00000100:00100000:1.0:1787560450.255841:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815541760 00000100:00100000:2.0:1787560450.255910:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815541504 00000100:00100000:2.0:1787560450.255913:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815541504 00000100:00100000:2.0:1787560450.255939:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787560450.255945:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815541376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560450.255987:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787560450.255997:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815541376:12345-0@lo:400:kworker.0 Request processed in 52us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560450.256000:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815541504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560450.256009:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787560450.256047:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815541504:12345-0@lo:400:kworker.0 Request processed in 53us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560450.256055:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787560450.256057:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815541888 00000100:00100000:2.0:1787560450.256068:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815541888 00000100:00100000:2.0:1787560450.256156:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815541632 00000100:00100000:2.0:1787560450.256159:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815541632 00000100:00100000:2.0:1787560450.256181:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560450.256191:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815541888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.256221:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787560450.256232:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815541760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560450.256237:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815541888:12345-0@lo:400:kworker.0 Request processed in 48us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560450.256246:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560450.256275:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815541760:12345-0@lo:400:kworker.0 Request processed in 45us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560450.256277:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560450.256289:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815541632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.256303:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787560450.256327:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560450.256333:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815541632:12345-0@lo:400:kworker.0 Request processed in 44us (529us total) trans 0 rc 0/0 00000100:00080000:1.0:1787560450.256333:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560450.256339:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560450.256343:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787560450.256373:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883424380 x1874392815541632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560450.256388:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815541632:0@lo:400:kworker.0 00000100:00100000:2.0:1787560450.256391:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815541248:0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.256407:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815541504:0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.256442:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815541760:0@lo:400:kworker.0 00000100:00100000:1.0:1787560450.256453:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815541376:0@lo:400:kworker.0 00010000:00080000:1.0:1787560450.256462:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883425c00 x1874392815541888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560450.256470:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815541888:0@lo:400:kworker.0 00010000:00010000:3.0:1787560450.767126:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560450.767206:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560450.767229:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815542016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560450.767297:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560450.767410:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815542016 00000100:00100000:3.0:1787560450.767419:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815542016 00000100:00100000:3.0:1787560450.767473:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560450.767483:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815542016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560450.767520:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560450.767578:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815542016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560450.767586:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787560450.767726:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c4000 x1874392815542016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560450.767746:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815542016:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787560451.421182:0:9339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.82 00010000:00010000:1.0:1787560451.797630:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560452.823185:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560453.339279:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560453.339301:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815542144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560453.339367:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560453.339428:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815542144 00000100:00100000:0.0:1787560453.339436:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815542144 00000100:00100000:0.0:1787560453.339488:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787560453.339503:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815542144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560453.339534:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560453.339592:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815542144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560453.339599:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787560453.339621:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560453.339648:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883426d80 x1874392815542144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560453.339667:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815542144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787560453.841115:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787560453.867463:0:9436:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.82 00000100:00100000:1.0:1787560454.579001:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560454.579061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560454.579189:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788246784 00000100:00100000:3.0:1787560454.579199:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788246784 00000100:00100000:3.0:1787560454.579281:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:3.0:1787560454.579291:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788246784:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560454.579364:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788246784:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 74us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560454.579385:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00080000:1.0:1787560454.579705:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560454.579876:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788246656 00000100:00100000:0.0:1787560454.579882:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788246656 00000100:00100000:0.0:1787560454.579928:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 200 00000100:00100000:0.0:1787560454.579937:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2344:x1874392788246656:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560454.579980:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2344:x1874392788246656:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 45us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560454.579987:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 200 00010000:00010000:2.0:1787560454.868146:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560455.375711:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815542272:0@lo:400:kworker.0 00000100:00100000:1.0:1787560455.375785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560455.376176:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815542272 00000100:00100000:3.0:1787560455.376186:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815542272 00000100:00100000:3.0:1787560455.376239:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787560455.376249:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815542272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560455.379182:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815542272:12345-0@lo:400:kworker.0 Request processed in 2925us (3387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560455.379197:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787560455.379642:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815542400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560455.379697:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560455.379726:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815542912:0@lo:400:kworker.0 00000100:00100000:2.0:1787560455.379748:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560455.379778:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560455.379784:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815542784:0@lo:400:kworker.0 00000100:00100000:2.0:1787560455.379819:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560455.379861:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815542400 00000100:00100000:2.0:1787560455.379869:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815542400 00000100:00100000:2.0:1787560455.379911:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815542784 00000100:00100000:2.0:1787560455.379914:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815542784 00000100:00100000:2.0:1787560455.379943:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787560455.379951:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815542400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560455.380058:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815542528:0@lo:400:kworker.0 00000100:00100000:0.0:1787560455.380101:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560455.380127:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560455.380133:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815542656:0@lo:400:kworker.0 00000100:00100000:0.0:1787560455.380162:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560455.380398:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815542400:12345-0@lo:400:kworker.0 Request processed in 447us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560455.380405:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787560455.380420:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815542528 00000100:00100000:2.0:1787560455.380423:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815542528 00000100:00100000:2.0:1787560455.380440:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560455.380446:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815542784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560455.380474:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815542784:12345-0@lo:400:kworker.0 Request processed in 29us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560455.380480:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560455.380491:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787560455.380497:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815542528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560455.380607:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815542784:0@lo:400:kworker.0 00000100:00100000:0.0:1787560455.380618:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815542400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560455.380671:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815542528:12345-0@lo:400:kworker.0 Request processed in 174us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560455.380678:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787560455.380703:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815542912 00000100:00100000:2.0:1787560455.380707:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815542912 00000100:00100000:2.0:1787560455.380737:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815542656 00000100:00100000:2.0:1787560455.380740:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815542656 00000100:00100000:2.0:1787560455.380776:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560455.380782:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815542912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560455.380826:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815542912:12345-0@lo:400:kworker.0 Request processed in 45us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560455.380833:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560455.380843:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560455.380868:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815542656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560455.380893:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815542656:12345-0@lo:400:kworker.0 Request processed in 28us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560455.380899:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787560455.380926:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735a680 x1874392815542912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560455.380937:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815542912:0@lo:400:kworker.0 00000100:00100000:1.0:1787560455.381299:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815542272:0@lo:400:kworker.0 00000100:00080000:1.0:1787560455.381321:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560455.381325:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560455.381334:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560455.381391:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815542528:0@lo:400:kworker.0 00010000:00080000:2.0:1787560455.381483:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d987358e00 x1874392815542656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560455.381493:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815542656:0@lo:400:kworker.0 00000001:02000400:3.0:1787560455.656866:0:9485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 04:34:14 EDT 2026 00000100:00100000:0.0:1787560455.887692:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560455.887716:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815543040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560455.887788:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560455.887987:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815543040 00000100:00100000:3.0:1787560455.887995:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815543040 00000100:00100000:3.0:1787560455.888047:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787560455.888057:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815543040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560455.888186:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560455.888248:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815543040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (458us total) trans 0 rc 0/0 00010000:00080000:1.0:1787560455.888385:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c4000 x1874392815543040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560455.888406:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815543040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560455.888458:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787560455.888679:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560456.914287:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560457.939154:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560458.450671:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815543168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560458.450745:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560458.452039:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815543168 00000100:00100000:1.0:1787560458.452052:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815543168 00000100:00100000:1.0:1787560458.452287:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560458.452298:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815543168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560458.452333:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560458.452485:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815543168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560458.452492:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787560458.452538:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c5f80 x1874392815543168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560458.452557:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815543168:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560458.453582:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560458.976641:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560459.698083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560459.698166:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788247040 00000100:00100000:3.0:1787560459.698196:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788247040 00000100:00100000:2.0:1787560459.698196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560459.698248:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788246912 00000100:00100000:2.0:1787560459.698257:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788246912 00000100:00100000:3.0:1787560459.698308:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:2.0:1787560459.698320:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 202 00000100:00100000:3.0:1787560459.698342:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788247040:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560459.698343:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2343:x1874392788246912:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560459.698422:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2343:x1874392788246912:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560459.698438:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788247040:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 117us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560459.698453:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:2.0:1787560459.698470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 202 00000100:00080000:3.0:1787560459.698492:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787560459.983022:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560460.495497:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815543552:0@lo:400:kworker.0 00000100:00100000:0.0:1787560460.495593:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560460.495671:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560460.495678:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815543680:0@lo:400:kworker.0 00000100:00100000:0.0:1787560460.495708:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560460.495764:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815543552 00000100:00100000:0.0:1787560460.495785:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815543552 00000100:00100000:0.0:1787560460.495873:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787560460.495892:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815543552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560460.495956:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815543552:12345-0@lo:400:kworker.0 Request processed in 73us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560460.495965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787560460.495995:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815543680 00000100:00100000:0.0:1787560460.495999:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815543680 00000100:00100000:0.0:1787560460.496032:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560460.496040:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815543680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560460.496074:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815543680:12345-0@lo:400:kworker.0 Request processed in 35us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560460.496080:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787560460.496108:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560460.496114:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787560460.496152:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883424000 x1874392815543680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560460.496167:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815543680:0@lo:400:kworker.0 00000100:00100000:0.0:1787560460.496179:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815543552:0@lo:400:kworker.0 00000100:00100000:1.0:1787560460.498101:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815543296:0@lo:400:kworker.0 00000100:00100000:1.0:1787560460.498194:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560460.498246:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815543808:0@lo:400:kworker.0 00000100:00100000:1.0:1787560460.498280:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560460.498324:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787560460.498334:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815543424:0@lo:400:kworker.0 00000100:00100000:1.0:1787560460.498365:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560460.498390:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815543936:0@lo:400:kworker.0 00000100:00100000:1.0:1787560460.498421:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560460.498504:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815543296 00000100:00100000:1.0:1787560460.498513:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815543296 00000100:00100000:1.0:1787560460.498575:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787560460.498588:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815543296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560460.498646:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815543296:12345-0@lo:400:kworker.0 Request processed in 62us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560460.498654:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787560460.498693:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815543808 00000100:00100000:1.0:1787560460.498698:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815543808 00000100:00100000:1.0:1787560460.498950:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815543424 00000100:00100000:1.0:1787560460.498954:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815543424 00000100:00100000:1.0:1787560460.498975:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787560460.498983:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815543808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560460.499023:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815543808:12345-0@lo:400:kworker.0 Request processed in 41us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560460.499029:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787560460.499042:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787560460.499049:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815543424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560460.499076:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815543424:12345-0@lo:400:kworker.0 Request processed in 29us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560460.499082:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787560460.499125:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815543424:0@lo:400:kworker.0 00000100:00100000:1.0:1787560460.499135:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815543296:0@lo:400:kworker.0 00000100:00100000:1.0:1787560460.499145:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815543808:0@lo:400:kworker.0 00000100:00100000:0.0:1787560460.500049:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815543936 00000100:00100000:0.0:1787560460.500065:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815543936 00000100:00100000:0.0:1787560460.500142:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560460.500163:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815543936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560460.500276:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815543936:12345-0@lo:400:kworker.0 Request processed in 124us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560460.500285:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787560460.500319:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560460.500325:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787560460.502311:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883427480 x1874392815543936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560460.502351:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815543936:0@lo:400:kworker.0 00000100:00100000:0.0:1787560461.007066:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815544064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560461.007168:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560461.007359:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815544064 00000100:00100000:2.0:1787560461.007370:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815544064 00000100:00100000:2.0:1787560461.007440:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560461.007453:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815544064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560461.007502:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00010000:3.0:1787560461.010900:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560461.011751:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815544064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4290us (4574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560461.011768:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787560461.011858:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b38a1f80 x1874392815544064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560461.011893:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815544064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560462.032182:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560463.056129:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560463.567250:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560463.567274:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815544192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560463.567355:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560463.567427:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815544192 00000100:00100000:0.0:1787560463.567435:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815544192 00000100:00100000:0.0:1787560463.568073:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560463.568094:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815544192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560463.568130:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560463.568177:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815544192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560463.568185:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787560463.568225:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883424000 x1874392815544192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560463.568244:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815544192:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787560463.568312:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787560464.080641:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560464.824225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560464.824327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560464.826108:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788247296 00000100:00100000:0.0:1787560464.826127:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788247296 00000100:00100000:0.0:1787560464.826237:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:0.0:1787560464.826257:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788247296:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560464.826369:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788247296:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 122us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560464.826378:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00080000:1.0:1787560464.826845:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560464.830793:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788247168 00000100:00100000:2.0:1787560464.830824:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788247168 00000100:00100000:2.0:1787560464.830913:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 204 00000100:00100000:2.0:1787560464.830925:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2345:x1874392788247168:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560464.831053:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2345:x1874392788247168:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 129us (6843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560464.831062:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 204 00010000:00010000:0.0:1787560465.103124:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560465.615353:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815544576:0@lo:400:kworker.0 00000100:00100000:1.0:1787560465.615443:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560465.615512:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560465.615521:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815544704:0@lo:400:kworker.0 00000100:00100000:1.0:1787560465.615554:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560465.615595:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815544576 00000100:00100000:1.0:1787560465.615603:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815544576 00000100:00100000:1.0:1787560465.615677:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787560465.615689:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815544576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560465.615752:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815544576:12345-0@lo:400:kworker.0 Request processed in 66us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560465.615759:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787560465.615782:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815544704 00000100:00100000:1.0:1787560465.615785:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815544704 00000100:00100000:0.0:1787560465.616143:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815544448:0@lo:400:kworker.0 00000100:00100000:0.0:1787560465.616219:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560465.616257:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815544960:0@lo:400:kworker.0 00000100:00100000:0.0:1787560465.616287:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560465.616324:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787560465.616332:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815544320:0@lo:400:kworker.0 00000100:00100000:0.0:1787560465.616364:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560465.616390:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815544832:0@lo:400:kworker.0 00000100:00100000:0.0:1787560465.616427:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560465.616460:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815544448 00000100:00100000:0.0:1787560465.616468:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815544448 00000100:00100000:1.0:1787560465.616591:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815544960 00000100:00100000:1.0:1787560465.616599:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815544960 00000100:00100000:1.0:1787560465.617559:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787560465.617571:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815544704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560465.617656:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815544704:12345-0@lo:400:kworker.0 Request processed in 87us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560465.617665:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787560465.617710:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560465.617717:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815544960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560465.617754:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815544960:12345-0@lo:400:kworker.0 Request processed in 38us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560465.617760:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787560465.619104:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815544832 00000100:00100000:0.0:1787560465.619121:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815544832 00000100:00100000:0.0:1787560465.619181:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787560465.619192:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815544448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560465.619286:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815544448:12345-0@lo:400:kworker.0 Request processed in 95us (3066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560465.619293:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787560465.619312:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787560465.619319:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815544832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560465.619350:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815544832:12345-0@lo:400:kworker.0 Request processed in 33us (2923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560465.619356:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787560465.630638:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560465.630649:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560465.630652:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560465.631889:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815544320 00000100:00100000:2.0:1787560465.631912:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815544320 00000100:00100000:2.0:1787560465.632006:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787560465.632020:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815544320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560465.632146:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815544320:12345-0@lo:400:kworker.0 Request processed in 126us (15777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560465.632155:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00080000:1.0:1787560465.632317:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b38a3480 x1874392815544704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560465.632336:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815544704:0@lo:400:kworker.0 00000100:00100000:1.0:1787560465.632360:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815544576:0@lo:400:kworker.0 00000100:00100000:2.0:1787560465.634139:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815544320:0@lo:400:kworker.0 00000100:00100000:2.0:1787560465.634186:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815544832:0@lo:400:kworker.0 00000100:00100000:2.0:1787560465.634199:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815544448:0@lo:400:kworker.0 00010000:00080000:2.0:1787560465.634216:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b38a0700 x1874392815544960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560465.634229:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815544960:0@lo:400:kworker.0 00000100:00100000:0.0:1787560466.129720:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815545088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560466.129789:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560466.129875:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815545088 00000100:00100000:0.0:1787560466.129882:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815545088 00000100:00100000:0.0:1787560466.131181:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560466.131202:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815545088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560466.131240:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560466.131521:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815545088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 329us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560466.131529:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787560466.131587:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883425880 x1874392815545088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560466.131633:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815545088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787560466.137893:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560467.155073:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560468.182211:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560468.688444:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815545216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560468.688544:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560468.688648:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815545216 00000100:00100000:0.0:1787560468.688658:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815545216 00000100:00100000:0.0:1787560468.688729:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560468.688748:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815545216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560468.688799:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560468.688884:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815545216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560468.688893:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787560468.690561:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d883425880 x1874392815545216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560468.690609:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815545216:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787560468.690983:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787560469.204751:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560469.945733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560469.945800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560469.945903:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788247552 00000100:00100000:0.0:1787560469.945916:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788247552 00000100:00100000:0.0:1787560469.946033:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:0.0:1787560469.946047:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788247552:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560469.946155:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788247552:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 112us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560469.946164:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00080000:1.0:1787560469.946567:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560469.947059:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788247424 00000100:00100000:2.0:1787560469.947067:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788247424 00000100:00100000:2.0:1787560469.947169:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 206 00000100:00100000:2.0:1787560469.947180:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2345:x1874392788247424:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560469.947247:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2345:x1874392788247424:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 70us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560469.947254:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 206 00010000:00010000:3.0:1787560470.223137:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560470.735317:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815545344:0@lo:400:kworker.0 00000100:00100000:1.0:1787560470.735428:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560470.735513:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560470.735520:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815545472:0@lo:400:kworker.0 00000100:00100000:1.0:1787560470.735564:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560470.735608:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815545472 00000100:00100000:1.0:1787560470.735618:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815545472 00000100:00100000:1.0:1787560470.735675:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787560470.735685:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815545472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560470.735740:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815545472:12345-0@lo:400:kworker.0 Request processed in 56us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.735764:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787560470.735822:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815545472:0@lo:400:kworker.0 00000100:00100000:0.0:1787560470.736046:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815545600:0@lo:400:kworker.0 00000100:00100000:0.0:1787560470.736086:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560470.736512:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815545344 00000100:00100000:2.0:1787560470.736518:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815545344 00000100:00100000:2.0:1787560470.736577:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787560470.736587:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815545344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560470.736633:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815545344:12345-0@lo:400:kworker.0 Request processed in 49us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560470.736640:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787560470.736671:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815545600 00000100:00100000:2.0:1787560470.736675:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815545600 00000100:00100000:2.0:1787560470.736710:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560470.736716:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815545600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560470.736766:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815545600:12345-0@lo:400:kworker.0 Request processed in 49us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560470.736773:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560470.736818:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815545600:0@lo:400:kworker.0 00000100:00080000:1.0:1787560470.737310:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560470.737335:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815545344:0@lo:400:kworker.0 00000100:00100000:0.0:1787560470.737471:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815545728:0@lo:400:kworker.0 00000100:00100000:0.0:1787560470.737509:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560470.737649:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815545728 00000100:00100000:1.0:1787560470.737654:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815545728 00000100:00100000:1.0:1787560470.737707:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787560470.737714:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815545728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560470.737752:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815545728:12345-0@lo:400:kworker.0 Request processed in 39us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.737758:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787560470.737818:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560470.737840:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b38a3100 x1874392815545728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560470.737875:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815545728:0@lo:400:kworker.0 00000100:00100000:2.0:1787560470.737985:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815545984:0@lo:400:kworker.0 00000100:00100000:2.0:1787560470.738016:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560470.738044:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560470.738050:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815545856:0@lo:400:kworker.0 00000100:00100000:2.0:1787560470.738073:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560470.738416:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815545856 00000100:00100000:0.0:1787560470.738421:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815545856 00000100:00100000:0.0:1787560470.738533:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787560470.738552:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815545856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560470.738591:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815545856:12345-0@lo:400:kworker.0 Request processed in 52us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560470.738598:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787560470.738667:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815545984 00000100:00100000:1.0:1787560470.738671:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815545984 00000100:00100000:1.0:1787560470.738704:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787560470.738711:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815545984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560470.738745:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815545984:12345-0@lo:400:kworker.0 Request processed in 35us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560470.738751:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787560470.738995:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560470.739000:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560470.739026:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815545856:0@lo:400:kworker.0 00010000:00080000:2.0:1787560470.739038:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b38a0700 x1874392815545984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560470.739048:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815545984:0@lo:400:kworker.0 00000100:00100000:1.0:1787560471.247256:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560471.247289:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815546112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560471.247380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560471.247473:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815546112 00000100:00100000:1.0:1787560471.247483:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815546112 00000100:00100000:1.0:1787560471.247556:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787560471.247566:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815546112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787560471.247629:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560471.247677:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815546112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560471.247685:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787560471.247738:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b38a3b80 x1874392815546112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560471.247768:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815546112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787560471.252503:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560472.271198:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787560472.364779:0:10115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 04:34:30 (1787560470) === 00000100:00100000:0.0:1787560473.099003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560473.099177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788247680 00000100:00100000:2.0:1787560473.099192:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788247680 00000100:00100000:2.0:1787560473.099266:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 208 00000100:00100000:2.0:1787560473.099280:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:8110:x1874392788247680:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787560473.099302:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560473.099328:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4463200/0xe34191b05673efe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9222a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560473.099402:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4463200/0xe34191b05673efe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9222a expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560473.099417:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4463200/0xe34191b05673efe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9222a expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560473.099429:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463200, rc 0) 00000100:00100000:2.0:1787560473.099513:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+11:8110:x1874392788247680:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 236us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.099520:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 208 00000100:00100000:0.0:1787560473.129945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560473.130213:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788247808 00000100:00100000:3.0:1787560473.130227:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788247808 00000100:00100000:3.0:1787560473.130298:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 209 00000100:00100000:3.0:1787560473.130311:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+11:8110:x1874392788247808:12345-192.168.201.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787560473.130718:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+11:8110:x1874392788247808:12345-192.168.201.56@tcp:501:mount.lustre.0 Request processed in 407us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.130728:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 209 00000100:00100000:1.0:1787560473.138281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560473.144130:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788247936 00000100:00100000:0.0:1787560473.144153:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788247936 00000100:00100000:0.0:1787560473.144260:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 210 00000100:00100000:0.0:1787560473.144273:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+11:8110:x1874392788247936:12345-192.168.201.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787560473.144604:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+11:8110:x1874392788247936:12345-192.168.201.56@tcp:503:mount.lustre.0 Request processed in 334us (6336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.144614:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 210 00000100:00100000:0.0:1787560473.155989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560473.156585:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788248064 00000100:00100000:2.0:1787560473.156600:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788248064 00000100:00100000:2.0:1787560473.156674:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 211 00000100:00100000:2.0:1787560473.156686:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+11:8114:x1874392788248064:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560473.157714:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+11:8114:x1874392788248064:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 1023us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.157726:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 211 00000100:00100000:1.0:1787560473.167345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560473.167483:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788248192 00000100:00100000:3.0:1787560473.167509:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788248192 00000100:00100000:3.0:1787560473.167585:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 212 00000100:00100000:3.0:1787560473.167598:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+11:8114:x1874392788248192:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560473.168608:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+11:8114:x1874392788248192:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 1005us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.168635:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 212 00000100:00100000:1.0:1787560473.183090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560473.183248:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788248320 00000100:00100000:0.0:1787560473.183287:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788248320 00000100:00100000:0.0:1787560473.183373:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 213 00000100:00100000:0.0:1787560473.183387:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+11:8110:x1874392788248320:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787560473.183409:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560473.183434:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d980031600/0xe34191b05673efed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92254 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.183472:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980031600/0xe34191b05673efed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92254 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.183486:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d980031600/0xe34191b05673efed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92254 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.183509:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980031600, rc 0) 00000100:00100000:0.0:1787560473.183580:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+12:8110:x1874392788248320:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 197us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.183588:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 213 00000100:00100000:0.0:1787560473.192088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560473.192193:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788248448 00000100:00100000:3.0:1787560473.192207:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788248448 00000100:00100000:3.0:1787560473.192347:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 214 00000100:00100000:3.0:1787560473.192359:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+12:8110:x1874392788248448:12345-192.168.201.56@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787560473.192393:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787560473.192415:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787560473.192420:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787560473.192424:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787560473.192426:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787560473.197511:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+12:8110:x1874392788248448:12345-192.168.201.56@tcp:256:mount.lustre.0 Request processed in 5130us (5414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.197530:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 214 00000100:00100000:1.0:1787560473.207146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560473.207238:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788248576 00000100:00100000:0.0:1787560473.207249:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788248576 00000100:00100000:0.0:1787560473.207381:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 215 00000100:00100000:0.0:1787560473.207393:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+12:8110:x1874392788248576:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787560473.207413:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560473.207436:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d980030c00/0xe34191b05673eff4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9225b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.207471:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980030c00/0xe34191b05673eff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9225b expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.207514:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d980030c00/0xe34191b05673eff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9225b expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560473.207525:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980030c00, rc 0) 00000100:00100000:0.0:1787560473.207624:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:8110:x1874392788248576:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 234us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.207629:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 215 00000100:00100000:0.0:1787560473.208899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560473.208964:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788248704 00000100:00100000:3.0:1787560473.208971:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788248704 00000100:00100000:3.0:1787560473.209009:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 216 00000100:00100000:3.0:1787560473.209017:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:8110:x1874392788248704:12345-192.168.201.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787560473.209364:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:8110:x1874392788248704:12345-192.168.201.56@tcp:501:mount.lustre.0 Request processed in 346us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.209372:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 216 00000100:00100000:1.0:1787560473.211186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560473.211355:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788248832 00000100:00100000:2.0:1787560473.211366:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788248832 00000100:00100000:2.0:1787560473.211464:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 217 00000100:00100000:2.0:1787560473.211476:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98328b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:8110:x1874392788248832:12345-192.168.201.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787560473.212026:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98328b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:8110:x1874392788248832:12345-192.168.201.56@tcp:503:mount.lustre.0 Request processed in 549us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.212037:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 217 00000100:00100000:1.0:1787560473.215231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560473.215406:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788248960 00000100:00100000:0.0:1787560473.215419:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788248960 00000100:00100000:0.0:1787560473.215546:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 218 00000100:00100000:0.0:1787560473.215560:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:8118:x1874392788248960:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560473.216135:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:8118:x1874392788248960:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 575us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.216145:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 218 00000100:00100000:0.0:1787560473.222185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560473.222348:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788249088 00000100:00100000:2.0:1787560473.222378:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788249088 00000100:00100000:2.0:1787560473.222450:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 219 00000100:00100000:2.0:1787560473.222462:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:8118:x1874392788249088:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560473.223163:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:8118:x1874392788249088:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 699us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.223173:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 219 00000100:00100000:1.0:1787560473.234629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560473.234745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560473.242031:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788249216 00000100:00100000:2.0:1787560473.243103:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788249216 00000100:00100000:2.0:1787560473.243183:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788249600 00000100:00100000:2.0:1787560473.243188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788249600 00000100:00100000:2.0:1787560473.243272:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:2.0:1787560473.243286:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788249600:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560473.243408:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788249600:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 125us (8662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.243417:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:2.0:1787560473.243441:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:2.0:1787560473.243446:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2341:x1874392788249216:12345-192.168.201.56@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787560473.243475:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bb11441b-9d90-4ed1-83a2-9b2acf931bae@192.168.201.56@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:2.0:1787560473.243535:0:5837:0:(genops.c:1385:class_connect()) connect: client bb11441b-9d90-4ed1-83a2-9b2acf931bae, cookie 0xe34191b05673effb 00000004:00100000:2.0:1787560473.243575:0:5837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787560473.245277:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560473.254114:0:5837:0:(import.c:65:import_set_state_nolock()) ffff93d9bb20b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560473.254770:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2341:x1874392788249216:12345-192.168.201.56@tcp:38:mount.lustre.0 Request processed in 11318us (20154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.254783:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:1.0:1787560473.269992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560473.270047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560473.270182:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788249472 00000100:00100000:2.0:1787560473.270213:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788249472 00000100:00100000:2.0:1787560473.270356:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788249344 00000100:00100000:2.0:1787560473.270360:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788249344 00000100:00100000:2.0:1787560473.270415:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:0.0:1787560473.270429:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:2.0:1787560473.270430:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+7:8110:x1874392788249472:12345-192.168.201.56@tcp:41:mount.lustre.0 00000100:00100000:0.0:1787560473.270460:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+7:0:x1874392788249344:12345-192.168.201.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787560473.270488:0:6706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1787560473.270507:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787560473.271006:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+7:8110:x1874392788249472:12345-192.168.201.56@tcp:41:mount.lustre.0 Request processed in 579us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.271016:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:0.0:1787560473.271189:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:0:x1874392788249344:12345-192.168.201.56@tcp:41:mount.lustre.0 Request processed in 741us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.271200:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00080000:3.0:1787560473.275806:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560473.278670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560473.278770:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788249728 00000100:00100000:0.0:1787560473.278787:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788249728 00000100:00100000:0.0:1787560473.279122:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:0.0:1787560473.279138:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:8110:x1874392788249728:12345-192.168.201.56@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787560473.279271:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:8110:x1874392788249728:12345-192.168.201.56@tcp:40:mount.lustre.0 Request processed in 138us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.279280:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:1.0:1787560473.282844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560473.282964:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560473.283005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560473.283051:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788250112 00000100:00100000:2.0:1787560473.283069:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788250112 00000100:00100000:2.0:1787560473.283152:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:2.0:1787560473.283164:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:8110:x1874392788250112:12345-192.168.201.56@tcp:33:mount.lustre.0 00000100:00100000:0.0:1787560473.283225:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788249856 00000100:00100000:0.0:1787560473.283235:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788249856 00000100:00100000:0.0:1787560473.283276:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788249984 00000100:00100000:0.0:1787560473.283280:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788249984 00000100:00100000:0.0:1787560473.283303:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:0.0:1787560473.283312:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1874392788249856:12345-192.168.201.56@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787560473.283347:0:8101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bb11441b-9d90-4ed1-83a2-9b2acf931bae@192.168.201.56@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:0.0:1787560473.283391:0:8101:0:(genops.c:1385:class_connect()) connect: client bb11441b-9d90-4ed1-83a2-9b2acf931bae, cookie 0xe34191b05673f002 00002000:00100000:0.0:1787560473.283407:0:8101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bb11441b-9d90-4ed1-83a2-9b2acf931bae/ffff93d9bf87f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787560473.283438:0:8101:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:2.0:1787560473.284176:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00002000:00080000:0.0:1787560473.285230:0:8101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1787560473.285259:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:8110:x1874392788250112:12345-192.168.201.56@tcp:33:mount.lustre.0 Request processed in 2088us (2423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560473.285271:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:3.0:1787560473.285781:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:3.0:1787560473.285807:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1874392788249984:12345-192.168.201.56@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787560473.285842:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bb11441b-9d90-4ed1-83a2-9b2acf931bae@192.168.201.56@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:3.0:1787560473.285907:0:6684:0:(genops.c:1385:class_connect()) connect: client bb11441b-9d90-4ed1-83a2-9b2acf931bae, cookie 0xe34191b05673f009 00002000:00100000:3.0:1787560473.285920:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bb11441b-9d90-4ed1-83a2-9b2acf931bae/ffff93d9b38e3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787560473.285944:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787560473.287218:0:8101:0:(import.c:65:import_set_state_nolock()) ffff93d9bf87f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560473.287591:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2341:x1874392788249856:12345-192.168.201.56@tcp:8:mount.lustre.0 Request processed in 4006us (4353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.287605:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00002000:00080000:3.0:1787560473.291446:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787560473.291512:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560473.291666:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2341:x1874392788249984:12345-192.168.201.56@tcp:8:mount.lustre.0 Request processed in 5870us (8658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560473.291678:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00010000:00010000:3.0:1787560473.294993:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560473.807405:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815546240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560473.807477:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560473.808096:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815546240 00000100:00100000:0.0:1787560473.808107:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815546240 00000100:00100000:0.0:1787560473.808184:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787560473.808199:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815546240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560473.808223:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560473.808279:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815546240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560473.808297:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787560473.808924:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a7b80 x1874392815546240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560473.808947:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815546240:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560473.809162:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787560473.886636:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bb11441b-9d90-4ed1-83a2-9b2acf931bae 00000001:00100000:1.0:1787560473.889643:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bb11441b-9d90-4ed1-83a2-9b2acf931bae 00010000:00010000:2.0:1787560474.319090:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787560474.398252:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bb11441b-9d90-4ed1-83a2-9b2acf931bae 00010000:00010000:2.0:1787560475.351570:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560475.856174:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815546368:0@lo:400:kworker.0 00000100:00100000:3.0:1787560475.856258:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560475.856300:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815546880:0@lo:400:kworker.0 00000100:00100000:2.0:1787560475.856326:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815546496:0@lo:400:kworker.0 00000100:00100000:3.0:1787560475.856338:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560475.856363:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560475.856377:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815547008:0@lo:400:kworker.0 00000100:00100000:3.0:1787560475.856378:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815546624:0@lo:400:kworker.0 00000100:00100000:3.0:1787560475.856400:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560475.856400:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560475.856422:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560475.856428:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815546752:0@lo:400:kworker.0 00000100:00100000:2.0:1787560475.856434:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815546880 00000100:00100000:2.0:1787560475.856441:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815546880 00000100:00100000:3.0:1787560475.856463:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560475.856515:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815546496 00000100:00100000:2.0:1787560475.856519:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815546496 00000100:00100000:2.0:1787560475.856532:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815546624 00000100:00100000:2.0:1787560475.856534:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815546624 00000100:00100000:2.0:1787560475.856549:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560475.856558:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815546880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560475.856608:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815546880:12345-0@lo:400:kworker.0 Request processed in 51us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560475.856614:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560475.856632:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787560475.856638:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815546496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560475.856667:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815546496:12345-0@lo:400:kworker.0 Request processed in 28us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560475.856672:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787560475.856696:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787560475.856702:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815546624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560475.856734:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815546624:12345-0@lo:400:kworker.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560475.856739:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787560475.856758:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815547008 00000100:00100000:2.0:1787560475.856761:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815547008 00000100:00100000:2.0:1787560475.856783:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815546752 00000100:00100000:2.0:1787560475.856791:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815546752 00000100:00100000:2.0:1787560475.856818:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560475.856825:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815547008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560475.856872:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815547008:12345-0@lo:400:kworker.0 Request processed in 48us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560475.856878:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560475.856891:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787560475.856896:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815546752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560475.856921:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815546752:12345-0@lo:400:kworker.0 Request processed in 26us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560475.856927:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787560475.856941:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560475.856944:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560475.856947:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560475.856987:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815546496:0@lo:400:kworker.0 00010000:00080000:2.0:1787560475.857001:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c7100 x1874392815547008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560475.857010:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815547008:0@lo:400:kworker.0 00010000:00080000:2.0:1787560475.857040:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c6d80 x1874392815546752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560475.857049:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815546752:0@lo:400:kworker.0 00000100:00100000:2.0:1787560475.857058:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815546624:0@lo:400:kworker.0 00000100:00100000:2.0:1787560475.857080:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815546880:0@lo:400:kworker.0 00000100:00100000:0.0:1787560475.859333:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815546368 00000100:00100000:0.0:1787560475.859349:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815546368 00000100:00100000:0.0:1787560475.859416:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787560475.859426:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815546368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560475.859551:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815546368:12345-0@lo:400:kworker.0 Request processed in 125us (3291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560475.859559:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787560475.859634:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815546368:0@lo:400:kworker.0 00000100:00100000:2.0:1787560476.367057:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815547136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560476.367180:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560476.367278:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560476.367318:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815547136 00000100:00100000:0.0:1787560476.367330:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815547136 00000100:00100000:0.0:1787560476.367405:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787560476.367419:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815547136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560476.367496:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560476.376491:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815547136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9061us (9297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560476.376511:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787560476.376672:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986a02d80 x1874392815547136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560476.376703:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815547136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787560477.391242:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560478.416373:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560478.644986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560478.645042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560478.645109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560478.645145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560478.645175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560478.645210:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788250496 00000100:00100000:1.0:1787560478.645223:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788250496 00000100:00100000:1.0:1787560478.645306:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788250368 00000100:00100000:1.0:1787560478.645310:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788250368 00000100:00100000:1.0:1787560478.645343:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:1.0:1787560478.645356:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788250496:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560478.645464:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788250496:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 111us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560478.645473:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:1.0:1787560478.645494:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:1.0:1787560478.645501:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788250368:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560478.645528:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788250368:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560478.645535:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:2.0:1787560478.645961:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788250240 00000100:00100000:2.0:1787560478.645967:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788250240 00000100:00100000:2.0:1787560478.646010:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 221 00000100:00100000:2.0:1787560478.646018:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2345:x1874392788250240:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560478.646061:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2345:x1874392788250240:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 44us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560478.646068:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 221 00000100:00100000:2.0:1787560478.646104:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788250752 00000100:00100000:2.0:1787560478.646108:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788250752 00000100:00100000:2.0:1787560478.646148:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788250624 00000100:00100000:2.0:1787560478.646151:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788250624 00000100:00100000:2.0:1787560478.646180:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:2.0:1787560478.646187:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788250752:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560478.646215:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788250752:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 29us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560478.646222:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:2.0:1787560478.646234:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:2.0:1787560478.646240:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788250624:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560478.646263:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788250624:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 24us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560478.646281:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00080000:3.0:1787560478.646503:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560478.646509:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560478.646512:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560478.929965:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815547264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560478.930067:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560478.930180:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815547264 00000100:00100000:2.0:1787560478.930190:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815547264 00000100:00100000:2.0:1787560478.930259:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787560478.930269:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815547264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560478.930312:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560478.930365:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815547264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560478.930373:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787560478.930432:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735b480 x1874392815547264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560478.930454:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815547264:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560478.932563:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787560479.443771:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787560480.079675:0:10315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787560480.464729:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560480.976559:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815547648:0@lo:400:kworker.0 00000100:00100000:2.0:1787560480.976625:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560480.976698:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560480.976704:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815547776:0@lo:400:kworker.0 00000100:00100000:2.0:1787560480.976746:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560480.976781:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815547648 00000100:00100000:2.0:1787560480.976788:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815547648 00000100:00100000:2.0:1787560480.976837:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787560480.976886:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815547648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560480.976933:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815547648:12345-0@lo:400:kworker.0 Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560480.976946:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787560480.976970:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815547776 00000100:00100000:2.0:1787560480.976974:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815547776 00000100:00100000:2.0:1787560480.977000:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787560480.977006:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815547776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560480.977036:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815547776:12345-0@lo:400:kworker.0 Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560480.977041:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787560480.977055:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560480.977060:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787560480.977094:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d98735ad80 x1874392815547776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560480.977108:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815547776:0@lo:400:kworker.0 00000100:00100000:2.0:1787560480.977119:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815547648:0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.977527:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815547520:0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.977560:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560480.977589:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815548032:0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.977610:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560480.977635:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787560480.977640:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815547392:0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.977665:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560480.977707:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815547904:0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.977728:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560480.977753:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815547520 00000100:00100000:1.0:1787560480.977757:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815547520 00000100:00100000:1.0:1787560480.977781:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815547904 00000100:00100000:1.0:1787560480.977784:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815547904 00000100:00100000:1.0:1787560480.977805:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787560480.977812:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815547520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.977862:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815547520:12345-0@lo:400:kworker.0 Request processed in 34us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560480.977868:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787560480.977881:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787560480.977888:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815547904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.977914:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815547904:12345-0@lo:400:kworker.0 Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560480.977920:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787560480.977936:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815548032 00000100:00100000:1.0:1787560480.977941:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815548032 00000100:00100000:1.0:1787560480.977965:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787560480.977971:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815548032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.978001:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815548032:12345-0@lo:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560480.978007:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787560480.978025:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815547392 00000100:00100000:1.0:1787560480.978028:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815547392 00000100:00100000:1.0:1787560480.978052:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787560480.978059:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815547392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.978097:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815547392:12345-0@lo:400:kworker.0 Request processed in 39us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560480.978104:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:1.0:1787560480.978138:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560480.978142:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560480.978162:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815547392:0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.978172:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815547904:0@lo:400:kworker.0 00000100:00100000:1.0:1787560480.978180:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815547520:0@lo:400:kworker.0 00010000:00080000:1.0:1787560480.978191:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d987358a80 x1874392815548032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560480.978200:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815548032:0@lo:400:kworker.0 00010000:00010000:2.0:1787560481.487077:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560481.487285:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560481.487308:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815548160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560481.487389:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560481.491735:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815548160 00000100:00100000:2.0:1787560481.491750:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815548160 00000100:00100000:2.0:1787560481.491886:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560481.491897:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815548160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560481.491943:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560481.492040:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815548160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (4651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560481.492048:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787560481.492139:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986a02a00 x1874392815548160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560481.492183:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815548160:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787560482.511557:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560483.535043:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560483.763579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560483.763627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560483.763653:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788250880 00000100:00100000:0.0:1787560483.763663:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788250880 00000100:00100000:1.0:1787560483.763665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560483.763692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560483.763750:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788251136 00000100:00100000:2.0:1787560483.763755:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788251136 00000100:00100000:3.0:1787560483.763892:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788251392 00000100:00100000:3.0:1787560483.763897:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788251392 00000100:00100000:0.0:1787560483.766397:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 223 00000100:00100000:0.0:1787560483.766413:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788250880:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560483.766418:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788251008 00000100:00100000:2.0:1787560483.766425:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788251008 00000100:00100000:0.0:1787560483.766497:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788250880:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 89us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560483.766505:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:0.0:1787560483.766505:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 223 00000100:00100000:3.0:1787560483.766513:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98a67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788251392:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560483.766540:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98a67c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788251392:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 29us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560483.766546:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:1.0:1787560483.767121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560483.767190:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788251264 00000100:00100000:0.0:1787560483.767195:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788251264 00000100:00100000:0.0:1787560483.767235:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:0.0:1787560483.767243:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788251264:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560483.767273:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788251264:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 32us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560483.767279:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:2.0:1787560483.768712:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:2.0:1787560483.768724:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788251136:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560483.768789:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788251136:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 56us (5151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560483.768797:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:2.0:1787560483.768813:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:2.0:1787560483.768819:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788251008:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560483.768859:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788251008:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 26us (5152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560483.768865:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00080000:0.0:1787560483.769299:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560483.769305:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560483.769308:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560484.048890:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815548288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560484.049080:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560484.049473:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815548288 00000100:00100000:2.0:1787560484.049483:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815548288 00000100:00100000:2.0:1787560484.049540:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787560484.049550:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815548288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560484.049593:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560484.049795:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815548288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 245us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560484.049802:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787560484.049823:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560484.050757:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9baf37b80 x1874392815548288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560484.050780:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815548288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787560484.558972:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560485.583254:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560486.097607:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815548672:0@lo:400:kworker.0 00000100:00100000:3.0:1787560486.097703:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560486.097780:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560486.097787:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815548800:0@lo:400:kworker.0 00000100:00100000:3.0:1787560486.097816:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560486.097878:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815548672 00000100:00100000:3.0:1787560486.097887:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815548672 00000100:00100000:3.0:1787560486.097955:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787560486.097967:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815548672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560486.098026:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815548672:12345-0@lo:400:kworker.0 Request processed in 61us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560486.098033:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787560486.098079:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815548800 00000100:00100000:3.0:1787560486.098082:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815548800 00000100:00100000:3.0:1787560486.098113:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787560486.098120:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815548800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560486.098152:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815548800:12345-0@lo:400:kworker.0 Request processed in 33us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560486.098158:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787560486.098174:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560486.098180:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787560486.098215:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c6a00 x1874392815548800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560486.098230:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815548800:0@lo:400:kworker.0 00000100:00100000:3.0:1787560486.098254:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815548672:0@lo:400:kworker.0 00000100:00100000:0.0:1787560486.098413:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815548416:0@lo:400:kworker.0 00000100:00100000:0.0:1787560486.098451:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560486.098476:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815548928:0@lo:400:kworker.0 00000100:00100000:0.0:1787560486.098498:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560486.098518:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787560486.098524:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815548544:0@lo:400:kworker.0 00000100:00100000:0.0:1787560486.098544:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560486.098560:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815549056:0@lo:400:kworker.0 00000100:00100000:0.0:1787560486.098581:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560486.098609:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815548928 00000100:00100000:0.0:1787560486.098613:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815548928 00000100:00100000:0.0:1787560486.098642:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815548544 00000100:00100000:0.0:1787560486.098645:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815548544 00000100:00100000:0.0:1787560486.098672:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787560486.098678:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815548928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560486.098714:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815548928:12345-0@lo:400:kworker.0 Request processed in 36us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560486.098721:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787560486.098736:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787560486.098742:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815548544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560486.098768:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815548544:12345-0@lo:400:kworker.0 Request processed in 26us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560486.098773:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787560486.098795:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815549056 00000100:00100000:0.0:1787560486.098798:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815549056 00000100:00100000:0.0:1787560486.098826:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560486.098833:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815549056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560486.098882:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815549056:12345-0@lo:400:kworker.0 Request processed in 50us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560486.098888:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787560486.098907:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560486.098911:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560486.098927:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815548544:0@lo:400:kworker.0 00010000:00080000:0.0:1787560486.098938:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c6d80 x1874392815549056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560486.098947:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815549056:0@lo:400:kworker.0 00000100:00100000:0.0:1787560486.098956:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815548928:0@lo:400:kworker.0 00000100:00100000:3.0:1787560486.099140:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815548416 00000100:00100000:3.0:1787560486.099144:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815548416 00000100:00100000:3.0:1787560486.099181:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787560486.099187:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815548416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560486.099228:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815548416:12345-0@lo:400:kworker.0 Request processed in 41us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560486.099234:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787560486.099381:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815548416:0@lo:400:kworker.0 00010000:00010000:3.0:1787560486.634248:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560486.637129:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560486.637176:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815549184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560486.637666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560486.637927:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815549184 00000100:00100000:0.0:1787560486.637938:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815549184 00000100:00100000:0.0:1787560486.637999:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787560486.638009:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815549184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560486.638056:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560486.638126:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815549184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560486.638134:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787560486.642449:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a4700 x1874392815549184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560486.642488:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815549184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560487.713841:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560488.722080:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560488.891208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560488.891426:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788251648 00000100:00100000:0.0:1787560488.891439:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788251648 00000100:00100000:0.0:1787560488.891598:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00100000:0.0:1787560488.891614:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788251648:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560488.891723:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788251648:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 114us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560488.891732:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00080000:3.0:1787560488.892774:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560488.898166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560488.898303:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788251904 00000100:00100000:2.0:1787560488.898317:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788251904 00000100:00100000:2.0:1787560488.898415:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:2.0:1787560488.898424:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788251904:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560488.898505:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788251904:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 84us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560488.898511:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00080000:0.0:1787560488.898668:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560488.899735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560488.899798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560488.899889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560488.900047:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788252032 00000100:00100000:2.0:1787560488.900055:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788252032 00000100:00100000:2.0:1787560488.900111:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:2.0:1787560488.900122:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788252032:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560488.900185:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788252032:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 64us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560488.900192:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00080000:1.0:1787560488.900322:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560488.900468:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788251776 00000100:00100000:3.0:1787560488.900480:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788251776 00000100:00100000:3.0:1787560488.900525:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00100000:3.0:1787560488.900531:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788251776:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560488.900569:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788251776:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 40us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560488.900575:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00080000:1.0:1787560488.900637:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560488.901046:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788251520 00000100:00100000:0.0:1787560488.901051:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788251520 00000100:00100000:0.0:1787560488.901113:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 225 00000100:00100000:0.0:1787560488.901122:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2343:x1874392788251520:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560488.901169:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2343:x1874392788251520:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 49us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560488.901177:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 225 00000100:00100000:2.0:1787560489.167551:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560489.167582:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815549312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560489.167672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560489.167729:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815549312 00000100:00100000:1.0:1787560489.167741:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815549312 00000100:00100000:1.0:1787560489.167838:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787560489.167870:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815549312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560489.167913:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560489.167967:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815549312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560489.167976:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787560489.168368:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787560489.168405:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9baf34000 x1874392815549312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560489.168426:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815549312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787560489.743049:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560490.767082:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560491.215085:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815549568:0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.215199:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560491.215270:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815550080:0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.215301:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560491.215352:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787560491.215359:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815549440:0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.215392:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560491.215415:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815549952:0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.215440:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560491.215470:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815549696:0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.215498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560491.215519:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560491.215525:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815549824:0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.215549:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560491.215581:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815550080 00000100:00100000:3.0:1787560491.215590:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815550080 00000100:00100000:3.0:1787560491.215659:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815549824 00000100:00100000:3.0:1787560491.215663:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815549824 00000100:00100000:3.0:1787560491.215689:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560491.215700:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815550080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.215764:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815550080:12345-0@lo:400:kworker.0 Request processed in 65us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560491.215798:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560491.215815:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787560491.215822:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815549824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.215885:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815549824:12345-0@lo:400:kworker.0 Request processed in 63us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560491.215892:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787560491.215913:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815549568 00000100:00100000:3.0:1787560491.215917:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815549568 00000100:00100000:3.0:1787560491.215944:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815549952 00000100:00100000:3.0:1787560491.215948:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815549952 00000100:00100000:3.0:1787560491.215961:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815549696 00000100:00100000:3.0:1787560491.215964:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815549696 00000100:00100000:3.0:1787560491.215977:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787560491.215984:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815549568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.216013:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815549568:12345-0@lo:400:kworker.0 Request processed in 30us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560491.216019:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787560491.216030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787560491.216036:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815549952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.216064:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815549952:12345-0@lo:400:kworker.0 Request processed in 28us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560491.216070:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787560491.216081:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787560491.216087:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815549696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.216115:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815549696:12345-0@lo:400:kworker.0 Request processed in 28us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560491.216130:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1787560491.216153:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560491.216158:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560491.216161:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787560491.216213:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c4380 x1874392815549824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560491.216229:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815549824:0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.216243:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815549696:0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.216278:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815549952:0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.216289:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815549568:0@lo:400:kworker.0 00010000:00080000:3.0:1787560491.216299:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9894c6300 x1874392815550080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560491.216309:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815550080:0@lo:400:kworker.0 00000100:00100000:2.0:1787560491.217127:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815549440 00000100:00100000:2.0:1787560491.217138:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815549440 00000100:00100000:2.0:1787560491.217201:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787560491.217212:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815549440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560491.217283:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815549440:12345-0@lo:400:kworker.0 Request processed in 73us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560491.217305:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787560491.217366:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815549440:0@lo:400:kworker.0 00000100:00100000:3.0:1787560491.728187:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815550208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560491.728296:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560491.728702:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815550208 00000100:00100000:0.0:1787560491.728722:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815550208 00000100:00100000:0.0:1787560491.728785:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560491.728795:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815550208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560491.728836:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560491.728916:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815550208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560491.728924:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787560491.729110:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a6d80 x1874392815550208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560491.729142:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815550208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787560491.791140:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560492.816597:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560493.844318:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560494.008568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560494.008619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560494.008646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560494.008670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560494.008736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560494.008765:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788252416 00000100:00100000:2.0:1787560494.008773:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788252416 00000100:00100000:1.0:1787560494.008921:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788252160 00000100:00100000:1.0:1787560494.008926:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788252160 00000100:00100000:1.0:1787560494.008967:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 227 00000100:00100000:1.0:1787560494.008977:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788252160:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560494.009048:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788252160:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 72us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560494.009056:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 227 00000100:00100000:2.0:1787560494.009219:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788252288 00000100:00100000:2.0:1787560494.009223:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788252288 00000100:00100000:2.0:1787560494.009267:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:2.0:1787560494.009275:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788252416:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560494.009308:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788252416:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 34us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560494.009314:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:2.0:1787560494.009327:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:2.0:1787560494.009333:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788252288:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560494.009357:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788252288:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560494.009363:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:2.0:1787560494.016653:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788252544 00000100:00100000:2.0:1787560494.016669:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788252544 00000100:00100000:2.0:1787560494.016755:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788252672 00000100:00100000:2.0:1787560494.016759:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788252672 00000100:00100000:2.0:1787560494.016785:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:2.0:1787560494.016795:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2341:x1874392788252544:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:2.0:1787560494.016825:0:6684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673f002 00000100:00080000:2.0:1787560494.016833:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93d9bf87f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560494.016890:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787560494.017238:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+2:2341:x1874392788252544:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 442us (8565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560494.017246:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:2.0:1787560494.017263:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:2.0:1787560494.017270:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2341:x1874392788252672:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:2.0:1787560494.017284:0:6684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673f009 00000100:00080000:2.0:1787560494.017289:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560494.017312:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787560494.017492:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+2:2341:x1874392788252672:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 221us (8754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560494.017499:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00080000:2.0:1787560494.017523:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560494.017527:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560494.017529:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787560494.017670:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560494.017676:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560494.289827:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815550336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560494.289912:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560494.289966:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815550336 00000100:00100000:3.0:1787560494.289974:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815550336 00000100:00100000:3.0:1787560494.290035:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787560494.290043:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815550336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560494.290075:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560494.290112:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815550336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560494.290118:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787560494.290153:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560494.291524:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9ba338700 x1874392815550336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560494.291558:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815550336:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787560494.398771:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bb11441b-9d90-4ed1-83a2-9b2acf931bae 00000020:00000080:1.0:1787560494.398781:0:7642:0:(genops.c:885:class_export_put()) final put ffff93d9b38e3800/bb11441b-9d90-4ed1-83a2-9b2acf931bae 00000020:00000080:1.0:1787560494.398814:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b38e3800/bb11441b-9d90-4ed1-83a2-9b2acf931bae for lustre-OST0001 00000020:00000080:1.0:1787560494.398876:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9b38e7800 for lustre-OST0001 00010000:00010000:1.0:1787560494.874734:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787560494.895399:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bb11441b-9d90-4ed1-83a2-9b2acf931bae 00000020:00000080:1.0:1787560494.895408:0:6708:0:(genops.c:885:class_export_put()) final put ffff93d9bf87f000/bb11441b-9d90-4ed1-83a2-9b2acf931bae 00000020:00000080:3.0:1787560494.895711:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9bf87f000/bb11441b-9d90-4ed1-83a2-9b2acf931bae for lustre-OST0000 00000020:00000080:3.0:1787560494.895763:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9bf87f800 for lustre-OST0000 00010000:00010000:2.0:1787560495.893529:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560496.335758:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815550720:0@lo:400:kworker.0 00000100:00100000:0.0:1787560496.335833:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560496.335927:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560496.335934:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815550848:0@lo:400:kworker.0 00000100:00100000:0.0:1787560496.335959:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560496.336029:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815550464:0@lo:400:kworker.0 00000100:00100000:1.0:1787560496.336071:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560496.336110:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815550976:0@lo:400:kworker.0 00000100:00100000:1.0:1787560496.336130:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560496.336144:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787560496.336149:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815550592:0@lo:400:kworker.0 00000100:00100000:1.0:1787560496.336167:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560496.336180:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815551104:0@lo:400:kworker.0 00000100:00100000:1.0:1787560496.336199:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560496.336273:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815550720 00000100:00100000:2.0:1787560496.336280:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815550720 00000100:00100000:2.0:1787560496.336334:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815550976 00000100:00100000:2.0:1787560496.336337:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815550976 00000100:00100000:2.0:1787560496.336360:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815550592 00000100:00100000:2.0:1787560496.336362:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815550592 00000100:00100000:2.0:1787560496.336376:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787560496.336384:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815550720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560496.336436:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815550720:12345-0@lo:400:kworker.0 Request processed in 52us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560496.336443:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787560496.336458:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787560496.336463:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815550976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560496.336493:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815550976:12345-0@lo:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560496.336499:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787560496.336511:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787560496.336517:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815550592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560496.336540:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815550592:12345-0@lo:400:kworker.0 Request processed in 24us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560496.336546:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787560496.336563:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815550848 00000100:00100000:2.0:1787560496.336567:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815550848 00000100:00100000:2.0:1787560496.336586:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815551104 00000100:00100000:2.0:1787560496.336588:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815551104 00000100:00100000:2.0:1787560496.336606:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787560496.336612:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815550848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560496.336640:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815550848:12345-0@lo:400:kworker.0 Request processed in 29us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560496.336646:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787560496.336656:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560496.336667:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815551104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560496.336695:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815551104:12345-0@lo:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560496.336701:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560496.336742:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815550592:0@lo:400:kworker.0 00010000:00080000:2.0:1787560496.336755:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9baf36680 x1874392815551104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560496.336764:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815551104:0@lo:400:kworker.0 00000100:00100000:2.0:1787560496.336772:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815550976:0@lo:400:kworker.0 00010000:00080000:2.0:1787560496.336797:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9baf34e00 x1874392815550848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560496.336806:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815550848:0@lo:400:kworker.0 00000100:00100000:2.0:1787560496.336814:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815550720:0@lo:400:kworker.0 00000100:00100000:0.0:1787560496.336880:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815550464 00000100:00100000:0.0:1787560496.336884:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815550464 00000100:00100000:0.0:1787560496.336919:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787560496.336926:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815550464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560496.336959:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815550464:12345-0@lo:400:kworker.0 Request processed in 34us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560496.336965:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:1.0:1787560496.337027:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560496.337031:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560496.337033:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560496.338684:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815550464:0@lo:400:kworker.0 00000100:00100000:3.0:1787560496.847226:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560496.847250:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815551232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560496.847319:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560496.853610:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815551232 00000100:00100000:0.0:1787560496.853624:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815551232 00000100:00100000:0.0:1787560496.853685:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560496.853694:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815551232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560496.853729:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560496.853819:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815551232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (6499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560496.853839:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787560496.853904:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a4e00 x1874392815551232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560496.853925:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815551232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787560496.911151:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560497.940284:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787560498.381289:0:11015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787560498.959201:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560499.125510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560499.125566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560499.125725:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788252800 00000100:00100000:2.0:1787560499.125735:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788252800 00000100:00100000:2.0:1787560499.125803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 229 00000100:00100000:2.0:1787560499.125814:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2343:x1874392788252800:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560499.125907:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2343:x1874392788252800:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 95us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560499.125915:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 229 00000100:00100000:1.0:1787560499.126200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560499.126263:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788253056 00000100:00100000:2.0:1787560499.126268:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788253056 00000100:00100000:2.0:1787560499.126309:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788252928 00000100:00100000:2.0:1787560499.126312:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788252928 00000100:00100000:2.0:1787560499.126330:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 89 00000100:00100000:2.0:1787560499.126337:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788253056:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560499.126381:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788253056:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 45us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560499.126387:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 89 00000100:00100000:2.0:1787560499.126397:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00100000:2.0:1787560499.126403:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788252928:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560499.126425:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788252928:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 23us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560499.126431:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00080000:1.0:1787560499.126779:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560499.412961:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560499.412986:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815551360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560499.413066:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560499.413216:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815551360 00000100:00100000:0.0:1787560499.413224:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815551360 00000100:00100000:0.0:1787560499.413278:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787560499.413288:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815551360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560499.413321:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560499.413368:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815551360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560499.413375:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1787560499.413397:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787560499.413424:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986a02a00 x1874392815551360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560499.413445:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815551360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787560499.983134:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560501.007129:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560501.456581:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560501.456662:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560501.456708:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815551616:0@lo:400:kworker.0 00000100:00100000:1.0:1787560501.456807:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560501.456915:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815551616 00000100:00100000:1.0:1787560501.456926:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815551616 00000100:00100000:1.0:1787560501.456980:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787560501.456989:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815551616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560501.457068:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815551616:12345-0@lo:400:kworker.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560501.457076:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787560501.457126:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815551616:0@lo:400:kworker.0 00000100:00100000:3.0:1787560501.459290:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815551488:0@lo:400:kworker.0 00000100:00100000:3.0:1787560501.459401:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560501.460040:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815551488 00000100:00100000:2.0:1787560501.460053:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815551488 00000100:00100000:2.0:1787560501.460118:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787560501.460129:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815551488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560501.460209:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815551488:12345-0@lo:400:kworker.0 Request processed in 81us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560501.460217:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787560501.460462:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815551488:0@lo:400:kworker.0 00000100:00100000:2.0:1787560501.463017:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560501.463115:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815551872:0@lo:400:kworker.0 00000100:00100000:2.0:1787560501.463206:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560501.463278:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874392815551744:0@lo:400:kworker.0 00000100:00100000:1.0:1787560501.463467:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815552000:0@lo:400:kworker.0 00000100:00100000:3.0:1787560501.463476:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815551872 00000100:00100000:3.0:1787560501.463487:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815551872 00000100:00100000:1.0:1787560501.463532:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560501.463558:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560501.463569:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815551872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560501.463618:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560501.463625:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815551872:12345-0@lo:400:kworker.0 Request processed in 58us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560501.463638:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787560501.463668:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a5500 x1874392815551872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560501.463697:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815551872:0@lo:400:kworker.0 00000100:00100000:2.0:1787560501.463731:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815552000 00000100:00100000:2.0:1787560501.463735:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815552000 00000100:00100000:2.0:1787560501.463774:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815551744 00000100:00100000:2.0:1787560501.463777:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815551744 00000100:00100000:2.0:1787560501.463799:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787560501.463805:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815552000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560501.463829:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787560501.463837:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874392815551744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560501.463894:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874392815551744:12345-0@lo:400:kworker.0 Request processed in 58us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560501.463900:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1787560501.464378:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560501.464385:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560501.464399:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815552128:0@lo:400:kworker.0 00000100:00100000:0.0:1787560501.464438:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560501.464811:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815552000:12345-0@lo:400:kworker.0 Request processed in 1002us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560501.464819:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787560501.465011:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815552128 00000100:00100000:2.0:1787560501.465019:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815552128 00000100:00100000:2.0:1787560501.465071:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787560501.465079:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815552128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560501.465128:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815552128:12345-0@lo:400:kworker.0 Request processed in 50us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560501.465135:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787560501.465179:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a6a00 x1874392815552128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560501.465193:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815552128:0@lo:400:kworker.0 00000100:00080000:0.0:1787560501.465796:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560501.465840:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874392815551744:0@lo:400:kworker.0 00000100:00100000:1.0:1787560501.466037:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815552000:0@lo:400:kworker.0 00000100:00100000:1.0:1787560501.968115:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815552256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560501.968215:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560501.968342:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815552256 00000100:00100000:0.0:1787560501.968362:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815552256 00000100:00100000:0.0:1787560501.968436:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787560501.968449:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815552256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560501.968512:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560501.968573:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815552256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560501.968592:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787560501.968595:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a5180 x1874392815552256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560501.968618:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815552256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787560502.035007:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787560502.148731:0:11162:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbabf8cf0 20000000:00000080:2.0:1787560502.148756:0:11162:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d9baba7c00 uarg=0000000000000000 20000000:01000000:2.0:1787560502.148811:0:11162:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787560502.148818:0:11162:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787560502.148824:0:11162:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787560502.151512:0:11163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787560502.152213:0:11162:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787560502.165220:0:11162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787560502.165769:0:11162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.165797:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4463e00/0xe34191b05673efb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92223 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.165807:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d980030800/0xe34191b05673efc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673efbc expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.165815:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4463000/0xe34191b05673efd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673efca expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.165822:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4463a00/0xe34191b05673efdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673efd8 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.165829:0:11162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d980030c00/0xe34191b05673eff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9225b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.165837:0:11162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.166078:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d980030c00/0xe34191b05673eff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9225b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.166110:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d980030c00/0xe34191b05673eff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9225b expref: 12 pid: 5831 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560502.166151:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1874392815552384:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560502.166296:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4463a00/0xe34191b05673efdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673efd8 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.166307:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9b4463a00/0xe34191b05673efdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673efd8 expref: 18 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560502.166317:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf35880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1874392815552512:0@lo:104: 00000100:00100000:2.0:1787560502.166364:0:11162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560502.166403:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4463000/0xe34191b05673efd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673efca expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.166412:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9b4463000/0xe34191b05673efd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673efca expref: 18 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560502.166421:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1874392815552640:0@lo:104: 00000100:00100000:2.0:1787560502.166438:0:11162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560502.166458:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d980030800/0xe34191b05673efc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673efbc expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.166465:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d980030800/0xe34191b05673efc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673efbc expref: 18 pid: 5832 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560502.166473:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1874392815552768:0@lo:104: 00000100:00100000:2.0:1787560502.166491:0:11162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560502.166507:0:11162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4463e00/0xe34191b05673efb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92223 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.166528:0:11162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9b4463e00/0xe34191b05673efb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92223 expref: 12 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560502.166537:0:11162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1874392815552896:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560502.166561:0:11162:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b382dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560502.168134:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815552512 00000100:00100000:3.0:1787560502.168151:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815552512 00000100:00100000:3.0:1787560502.168299:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815552640 00000100:00100000:3.0:1787560502.168303:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815552640 00000100:00100000:3.0:1787560502.168314:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815552768 00000100:00100000:3.0:1787560502.168317:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815552768 00000100:00100000:3.0:1787560502.168335:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560502.168346:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:11162:x1874392815552512:12345-0@lo:104: 00010000:00010000:3.0:1787560502.168366:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560502.168602:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf35880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1874392815552512:0@lo:104: 00010000:00010000:3.0:1787560502.168690:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560502.168699:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:11162:x1874392815552512:12345-0@lo:104: Request processed in 354us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560502.168708:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560502.168729:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787560502.168736:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:11162:x1874392815552640:12345-0@lo:104: 00010000:00010000:3.0:1787560502.168762:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560502.168838:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1874392815552640:0@lo:104: 00010000:00010000:1.0:1787560502.170185:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560502.170199:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.170273:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da000 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560502.170278:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.170290:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560502.170298:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560502.170305:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560502.170413:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.170438:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560502.170469:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.170477:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21da000/0xe34191b05673efd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673efdf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.170498:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560502.170501:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.170507:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dac00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560502.170510:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.170516:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560502.170523:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560502.170528:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787560502.170656:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815553024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560502.170742:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560502.170955:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815553024 00000100:00100000:0.0:1787560502.170964:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815553024 00010000:00010000:0.0:1787560502.171012:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4463a00/0xe34191b05673efdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673efd8 expref: 19 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560502.171047:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787560502.171058:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e10850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815553024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560502.171072:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560502.171079:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4463a00/0xe34191b05673efdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673efd8 expref: 19 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560502.171100:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4463a00/0xe34191b05673efdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673efd8 expref: 19 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560502.171118:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4463a00/0xe34191b05673efdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673efd8 expref: 19 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560502.171134:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560502.171173:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e10850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:3312:x1874392815553024:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560502.171180:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787560502.171269:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815553024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560502.171663:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787560502.171684:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:11162:x1874392815552640:12345-0@lo:104: Request processed in 2937us (5233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560502.171695:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787560502.171719:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560502.171728:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:11162:x1874392815552768:12345-0@lo:104: 00010000:00010000:3.0:1787560502.171740:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.171799:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560502.171804:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:11162:x1874392815552768:12345-0@lo:104: Request processed in 79us (5312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560502.171810:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787560502.171840:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560502.171866:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.171874:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dbe00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:3.0:1787560502.171878:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.171887:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560502.171894:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560502.171909:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787560502.172606:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf36300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1874392815552768:0@lo:104: 00010000:00010000:0.0:1787560502.172689:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560502.172801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560502.172910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560502.172937:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788253184 00000100:00100000:0.0:1787560502.172944:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788253184 00010000:00010000:0.0:1787560502.172978:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d980030c00/0xe34191b05673eff4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9225b expref: 13 pid: 5831 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560502.173020:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788253312 00000100:00100000:0.0:1787560502.173024:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788253312 00010000:00010000:0.0:1787560502.173036:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4463e00/0xe34191b05673efb5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92223 expref: 14 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560502.173056:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:0.0:1787560502.173065:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:194701de-fe21-4f70-a6ed-c87f3844b85e+14:2343:x1874392788253184:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560502.173079:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560502.173085:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d980030c00/0xe34191b05673eff4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9225b expref: 14 pid: 5831 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560502.173110:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d980030c00/0xe34191b05673eff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9225b expref: 14 pid: 5831 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560502.173131:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560502.173178:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:194701de-fe21-4f70-a6ed-c87f3844b85e+14:2343:x1874392788253184:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 114us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560502.173186:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:0.0:1787560502.173213:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:0.0:1787560502.173220:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788253312:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560502.173240:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560502.173245:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4463e00/0xe34191b05673efb5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92223 expref: 13 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560502.173253:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4463e00/0xe34191b05673efb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92223 expref: 13 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560502.173263:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560502.173281:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788253312:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 62us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560502.173287:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 27 00010000:00010000:2.0:1787560502.173721:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980030c00/0xe34191b05673eff4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9225b expref: 12 pid: 5831 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560502.173738:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1874392815552384:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560502.173750:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4463e00/0xe34191b05673efb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92223 expref: 11 pid: 5833 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560502.173758:0:11162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11162:1874392815552896:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560502.173791:0:11162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.174074:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.174084:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560502.174126:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.174133:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21dac00/0xe34191b05673efca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673efd1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560502.174165:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560502.174167:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560502.174169:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560502.174187:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560502.174690:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815553152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560502.174759:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560502.174919:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815553152 00000100:00100000:0.0:1787560502.174929:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815553152 00010000:00010000:0.0:1787560502.174964:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4463000/0xe34191b05673efd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673efca expref: 18 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560502.175008:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560502.175018:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:3314:x1874392815553152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560502.175032:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560502.175037:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4463000/0xe34191b05673efd1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673efca expref: 18 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560502.175050:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4463000/0xe34191b05673efd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673efca expref: 18 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560502.175066:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4463000/0xe34191b05673efd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673efca expref: 18 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560502.175080:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560502.175136:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:3314:x1874392815553152:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560502.175144:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787560502.175327:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815553152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560502.175547:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.175556:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560502.175583:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.175590:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbe00/0xe34191b05673efbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673efc3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.175608:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560502.175610:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560502.175611:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560502.175647:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560502.175658:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815553280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560502.175700:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560502.175885:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815553280 00000100:00100000:3.0:1787560502.175890:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815553280 00010000:00010000:3.0:1787560502.175911:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d980030800/0xe34191b05673efc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673efbc expref: 17 pid: 5832 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560502.175937:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787560502.175945:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:3313:x1874392815553280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560502.175956:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560502.175961:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d980030800/0xe34191b05673efc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673efbc expref: 17 pid: 5832 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.175970:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d980030800/0xe34191b05673efc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673efbc expref: 17 pid: 5832 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.175981:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980030800/0xe34191b05673efc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673efbc expref: 17 pid: 5832 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.176018:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.176028:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.176045:0:7630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.176051:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.176058:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.176064:0:7630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.176071:0:7630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4462c00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560502.176075:0:7630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.176084:0:7630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.176112:0:7630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560502.176124:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560502.176155:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3313:x1874392815553280:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560502.176172:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560502.176441:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815553280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560502.176536:0:11162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.176545:0:11162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560502.176553:0:11162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f010 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560503.055477:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787560503.508912:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560503.508921:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9bfc6d000 from 7 10000000:01000000:0.0:1787560503.508925:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560503.509010:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560503.509024:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560503.509038:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560503.509067:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815553408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560503.509149:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560503.509201:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9baace900 going to sleep for 11 seconds 00000100:00100000:2.0:1787560503.509281:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815553408 00000100:00100000:2.0:1787560503.509296:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815553408 00000100:00100000:2.0:1787560503.509357:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787560503.509367:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815553408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560503.509382:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560503.509399:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4463600/0xe34191b05673f01e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673f017 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560503.509426:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4463600/0xe34191b05673f01e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673f017 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560503.509436:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4463600/0xe34191b05673f01e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673f017 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560503.509448:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463600, rc 0) 00000100:00100000:2.0:1787560503.509485:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815553408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560503.509492:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787560503.509622:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815553408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560503.509641:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560503.509650:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560503.509722:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815553536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560503.509744:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560503.509765:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9baace900 going to sleep for 11 seconds 00000100:00100000:2.0:1787560503.510993:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815553536 00000100:00100000:2.0:1787560503.511007:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815553536 00000100:00100000:2.0:1787560503.511066:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787560503.511076:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815553536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560503.511867:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815553536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 770us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560503.511877:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787560503.518142:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815553536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560503.518385:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815553664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560503.518485:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560503.518560:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9baace900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560503.518997:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815553664 00000100:00100000:1.0:1787560503.519008:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815553664 00000100:00100000:1.0:1787560503.519074:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787560503.519085:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815553664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560503.519545:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815553664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 460us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560503.519555:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787560503.519672:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815553664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787560503.523366:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787560503.524409:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787560503.524465:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560503.524481:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560503.524496:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560503.524507:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560503.524511:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d986ace800 from 7 10000000:01000000:1.0:1787560503.524514:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560503.524560:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560503.524580:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560503.524594:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560503.524629:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815553792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560503.524774:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560503.524831:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bad680c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560503.524950:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815553792 00000100:00100000:1.0:1787560503.524963:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815553792 00000100:00100000:1.0:1787560503.525035:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787560503.525046:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815553792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560503.525062:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560503.525078:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4261400/0xe34191b05673f02c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673f025 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560503.525108:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4261400/0xe34191b05673f02c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673f025 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560503.525121:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4261400/0xe34191b05673f02c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673f025 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560503.525131:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261400, rc 0) 00000100:00100000:1.0:1787560503.525379:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815553792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 332us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560503.525387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787560503.532477:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815553792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560503.532537:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560503.532561:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560503.532675:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815553920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560503.532753:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560503.532807:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9baace6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560503.532951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815553920 00000100:00100000:2.0:1787560503.532961:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815553920 00000100:00100000:2.0:1787560503.533034:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787560503.533045:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815553920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560503.534684:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815553920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1633us (1923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560503.534699:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787560503.536602:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815553920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560503.536696:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815554048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560503.536792:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560503.536890:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560503.537431:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815554048 00000100:00100000:2.0:1787560503.537443:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815554048 00000100:00100000:2.0:1787560503.537508:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787560503.537520:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815554048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560503.537794:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815554048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560503.537803:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787560503.538464:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815554048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787560503.547497:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787560503.554029:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787560503.554086:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560503.554102:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560503.554118:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560503.554133:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787560503.554137:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d982bfc800 from 7 10000000:01000000:2.0:1787560503.554140:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560503.554195:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560503.554204:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560503.554240:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560503.554286:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815554176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560503.554510:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560503.554582:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b382d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560503.554759:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815554176 00000100:00100000:0.0:1787560503.554778:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815554176 00000100:00100000:2.0:1787560503.556228:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787560503.556249:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815554176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560503.556282:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560503.556411:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f03a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673f033 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560503.556449:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673f033 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560503.556462:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673f033 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560503.556472:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4462c00, rc 0) 00000100:00100000:2.0:1787560503.556565:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815554176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 324us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560503.556572:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787560503.556678:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815554176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560503.556700:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560503.556719:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560503.556811:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815554304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560503.556872:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560503.556905:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bad68840 going to sleep for 11 seconds 00000100:00100000:0.0:1787560503.556976:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815554304 00000100:00100000:0.0:1787560503.556984:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815554304 00000100:00100000:0.0:1787560503.557025:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787560503.557033:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815554304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560503.557477:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815554304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 443us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560503.557485:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787560503.557527:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4518a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815554304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560503.557567:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815554432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560503.557623:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560503.557648:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560503.557662:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815554432 00000100:00100000:3.0:1787560503.557666:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815554432 00000100:00100000:3.0:1787560503.557690:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787560503.557697:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815554432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560503.557883:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815554432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560503.557889:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787560503.557927:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9ba33b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815554432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787560503.559000:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787560503.559104:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787560503.559127:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560503.559140:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560503.559153:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560503.730040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560503.730225:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788253440 00000100:00100000:3.0:1787560503.730239:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788253440 00000100:00100000:3.0:1787560503.730330:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 240 00000100:00100000:3.0:1787560503.730343:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+11:5587:x1874392788253440:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560503.730385:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560503.730409:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f041 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92285 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560503.730448:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92285 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560503.730463:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92285 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560503.730474:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9829c5a00, rc 0) 00000100:00100000:3.0:1787560503.730555:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788253440:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 215us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560503.730563:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 240 00000100:00100000:0.0:1787560503.733425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560503.733584:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788253568 00000100:00100000:2.0:1787560503.733598:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788253568 00000100:00100000:2.0:1787560503.733665:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 241 00000100:00100000:2.0:1787560503.733678:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788253568:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560503.734148:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788253568:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 470us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560503.734158:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 241 00000100:00100000:2.0:1787560503.737927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560503.738023:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788253696 00000100:00100000:3.0:1787560503.738045:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788253696 00000100:00100000:3.0:1787560503.738107:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 242 00000100:00100000:3.0:1787560503.738118:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788253696:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560503.738415:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788253696:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 Request processed in 298us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560503.738425:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 242 00000100:00100000:3.0:1787560503.747365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560503.747523:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788253824 00000100:00100000:1.0:1787560503.747538:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788253824 00000100:00100000:1.0:1787560503.747650:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 243 00000100:00100000:1.0:1787560503.747664:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788253824:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560503.747687:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560503.747711:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4261000/0xe34191b05673f048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9228c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560503.747748:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4261000/0xe34191b05673f048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9228c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560503.747761:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4261000/0xe34191b05673f048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9228c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560503.747773:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261000, rc 0) 00000100:00100000:1.0:1787560503.747882:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:5587:x1874392788253824:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 220us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560503.747890:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 243 00000100:00100000:0.0:1787560503.753004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560503.753437:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788253952 00000100:00100000:3.0:1787560503.753451:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788253952 00000100:00100000:3.0:1787560503.753521:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 244 00000100:00100000:3.0:1787560503.753535:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:5587:x1874392788253952:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560503.754015:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:5587:x1874392788253952:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 480us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560503.754025:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 244 00000100:00100000:0.0:1787560503.760013:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560503.760370:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788254080 00000100:00100000:1.0:1787560503.760385:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788254080 00000100:00100000:1.0:1787560503.760480:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 245 00000100:00100000:1.0:1787560503.760493:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:5587:x1874392788254080:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560503.760796:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:5587:x1874392788254080:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 Request processed in 304us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560503.760806:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 245 00010000:00010000:1.0:1787560504.085256:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560504.253146:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560504.253191:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788254336 00000100:00100000:3.0:1787560504.253203:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788254336 00000100:00100000:1.0:1787560504.253217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560504.253257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560504.253304:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788254464 00000100:00100000:1.0:1787560504.253308:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788254464 00000100:00100000:1.0:1787560504.253369:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:1.0:1787560504.253380:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788254464:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560504.253449:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788254464:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 70us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560504.253456:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00080000:1.0:1787560504.253475:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560504.253943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 95 00000100:00100000:3.0:1787560504.253960:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788254336:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560504.253997:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788254336:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 47us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560504.254003:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 95 00000100:00100000:3.0:1787560504.254026:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788254208 00000100:00100000:3.0:1787560504.254031:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788254208 00000100:00100000:3.0:1787560504.254054:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 246 00000100:00100000:3.0:1787560504.254060:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2345:x1874392788254208:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560504.254084:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2345:x1874392788254208:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 25us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560504.254090:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 246 00000100:00080000:1.0:1787560504.254740:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560504.528105:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b451a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815554560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560504.529450:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560504.533488:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815554560 00000100:00100000:0.0:1787560504.533502:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815554560 00000100:00100000:0.0:1787560504.533567:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560504.533578:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815554560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560504.533612:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560504.533700:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815554560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (4251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560504.533708:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787560504.533934:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787560504.533984:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b451a680 x1874392815554560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560504.534004:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b451a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815554560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787560505.106806:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560506.127869:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787560506.140816:0:11360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787560506.575389:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815555072:0@lo:400:kworker.0 00000100:00100000:2.0:1787560506.575463:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560506.575545:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787560506.575552:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815554688:0@lo:400:kworker.0 00000100:00100000:2.0:1787560506.575583:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560506.575603:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815555200:0@lo:400:kworker.0 00000100:00100000:2.0:1787560506.575626:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560506.575754:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815554816:0@lo:400:kworker.0 00000100:00100000:3.0:1787560506.575785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560506.575815:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815555328:0@lo:400:kworker.0 00000100:00100000:3.0:1787560506.575838:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560506.575876:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560506.575882:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815554944:0@lo:400:kworker.0 00000100:00100000:3.0:1787560506.575928:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560506.575959:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815555072 00000100:00100000:3.0:1787560506.575966:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815555072 00000100:00100000:3.0:1787560506.576009:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815555328 00000100:00100000:3.0:1787560506.576012:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815555328 00000100:00100000:3.0:1787560506.576029:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787560506.576037:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815555072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560506.576088:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815555072:12345-0@lo:400:kworker.0 Request processed in 51us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560506.576095:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787560506.576108:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787560506.576114:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815555328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560506.576145:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815555328:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560506.576150:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787560506.576166:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815555200 00000100:00100000:3.0:1787560506.576181:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815555200 00000100:00100000:3.0:1787560506.576203:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815554816 00000100:00100000:3.0:1787560506.576206:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815554816 00000100:00100000:3.0:1787560506.576213:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815554944 00000100:00100000:3.0:1787560506.576215:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815554944 00000100:00100000:3.0:1787560506.576226:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787560506.576231:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815555200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560506.576258:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815555200:12345-0@lo:400:kworker.0 Request processed in 27us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560506.576264:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787560506.576275:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787560506.576280:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815554816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560506.576313:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815554816:12345-0@lo:400:kworker.0 Request processed in 33us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560506.576320:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787560506.576331:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787560506.576337:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815554944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560506.576361:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815554944:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560506.576367:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787560506.576410:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815554944:0@lo:400:kworker.0 00000100:00100000:3.0:1787560506.576420:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815554816:0@lo:400:kworker.0 00010000:00080000:3.0:1787560506.576431:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a4700 x1874392815555328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560506.576441:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815555328:0@lo:400:kworker.0 00000100:00100000:3.0:1787560506.576467:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815555200:0@lo:400:kworker.0 00010000:00080000:3.0:1787560506.576489:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a5880 x1874392815555072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560506.576498:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815555072:0@lo:400:kworker.0 00000100:00100000:1.0:1787560506.577458:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815554688 00000100:00100000:1.0:1787560506.577467:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815554688 00000100:00100000:1.0:1787560506.577542:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787560506.577552:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815554688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560506.577620:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815554688:12345-0@lo:400:kworker.0 Request processed in 70us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560506.577627:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1787560506.577660:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560506.577665:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560506.577668:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560506.577737:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815554688:0@lo:400:kworker.0 00000100:00100000:3.0:1787560507.088944:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560507.088981:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815555456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560507.089058:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560507.089261:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815555456 00000100:00100000:0.0:1787560507.089269:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815555456 00000100:00100000:0.0:1787560507.089324:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787560507.089334:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815555456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560507.089371:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560507.089432:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815555456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560507.089439:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787560507.089940:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a7b80 x1874392815555456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560507.089962:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815555456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560507.151050:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560508.175973:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560509.199131:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560509.367959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560509.367997:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560509.368036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560509.368103:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788254848 00000100:00100000:2.0:1787560509.368114:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788254848 00000100:00100000:3.0:1787560509.368157:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788254592 00000100:00100000:3.0:1787560509.368173:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788254592 00000100:00100000:2.0:1787560509.368190:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788254720 00000100:00100000:2.0:1787560509.368195:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788254720 00000100:00100000:3.0:1787560509.368215:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 248 00000100:00100000:3.0:1787560509.368225:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2345:x1874392788254592:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560509.368243:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:2.0:1787560509.368254:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788254848:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560509.368293:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2345:x1874392788254592:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 69us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560509.368301:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 248 00000100:00100000:2.0:1787560509.368312:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788254848:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 59us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560509.368321:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:2.0:1787560509.368338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00100000:2.0:1787560509.368346:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788254720:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560509.368372:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788254720:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560509.368392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00080000:1.0:1787560509.368551:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560509.647105:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560509.647127:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b451aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815555584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560509.647206:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560509.647382:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815555584 00000100:00100000:1.0:1787560509.647392:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815555584 00000100:00100000:1.0:1787560509.647457:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787560509.647467:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815555584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560509.647501:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560509.647549:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815555584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560509.647556:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787560509.647597:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b451aa00 x1874392815555584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560509.647614:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b451aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815555584:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787560509.647730:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787560510.118153:0:11460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 04:35:08 (1787560508) === 00010000:00010000:0.0:1787560510.228487:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560510.545217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560510.545316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560510.546654:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788255104 00000100:00100000:1.0:1787560510.546680:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788255104 00000100:00100000:1.0:1787560510.546745:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:1.0:1787560510.546755:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:9667:x1874392788255104:12345-192.168.201.56@tcp:700:mkdir.0 00000100:00100000:1.0:1787560510.546882:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:9667:x1874392788255104:12345-192.168.201.56@tcp:700:mkdir.0 Request processed in 127us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560510.546890:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:2.0:1787560510.548739:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788254976 00000100:00100000:2.0:1787560510.548753:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788254976 00000100:00100000:2.0:1787560510.548911:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:2.0:1787560510.548923:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788254976:12345-192.168.201.56@tcp:41:mkdir.0 00000004:00000024:2.0:1787560510.548966:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787560510.549076:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788254976:12345-192.168.201.56@tcp:41:mkdir.0 Request processed in 156us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560510.549084:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:3.0:1787560510.558446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560510.558509:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788255360 00000100:00100000:2.0:1787560510.558518:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788255360 00000100:00100000:2.0:1787560510.558629:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:2.0:1787560510.558642:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:9667:x1874392788255360:12345-192.168.201.56@tcp:36:mkdir.0 00010000:00010000:2.0:1787560510.558700:0:6706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560510.558773:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673ef30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9220e expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.558793:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:2.0:1787560510.558803:0:6706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560510.559219:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f04f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.559233:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f04f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.559243:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f04f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.559332:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.559340:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.559347:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560510.561332:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787560510.561351:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f04f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.561361:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f04f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.561368:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f04f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.561374:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4463a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560510.561379:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f04f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.561387:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f04f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.561403:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52200) 00010000:00010000:2.0:1787560510.561406:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560510.561411:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f04f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.561429:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f04f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560510.561450:0:6706:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011d25459 reply state 00000000f281bae2 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560510.561460:0:6706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560510.561700:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:9667:x1874392788255360:12345-192.168.201.56@tcp:36:mkdir.0 Request processed in 3056us (3261us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787560510.561710:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00010000:00010000:3.0:1787560510.564743:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560510.564760:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560510.564767:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560510.564773:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4463000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560510.564777:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560510.564785:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560510.564801:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93d987d52700) 00010000:00010000:3.0:1787560510.564804:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560510.564808:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560510.564826:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f056 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560510.573905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560510.573968:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788255488 00000100:00100000:0.0:1787560510.573979:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788255488 00000100:00100000:0.0:1787560510.574045:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:0.0:1787560510.574056:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:9669:x1874392788255488:12345-192.168.201.56@tcp:101:chmod.0 00010000:00010000:0.0:1787560510.574078:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560510.574116:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f05d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92293 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.574181:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f064 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.574195:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.574227:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560510.574298:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787560510.574302:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560510.574345:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.574372:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f05d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92293 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.574392:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92293 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.574400:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3c00) 00010000:00010000:0.0:1787560510.574403:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560510.574407:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980030800, rc 0) 00000100:00100000:0.0:1787560510.574467:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:9669:x1874392788255488:12345-192.168.201.56@tcp:101:chmod.0 Request processed in 413us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560510.574483:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:3.0:1787560510.581789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560510.582673:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788255744 00000100:00100000:0.0:1787560510.582685:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788255744 00000100:00100000:0.0:1787560510.582759:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:0.0:1787560510.582771:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:9669:x1874392788255744:12345-192.168.201.56@tcp:36:chmod.0 00010000:00010000:0.0:1787560510.582827:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560510.583204:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f064 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92293 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.583238:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3c00) 00010000:00010000:0.0:1787560510.583249:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560510.592827:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.592876:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.592890:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560510.594319:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000299246b5 reply state 00000000c6653a86 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560510.594334:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787560510.594356:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787560510.594462:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:9669:x1874392788255744:12345-192.168.201.56@tcp:36:chmod.0 Request processed in 11690us (12678us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787560510.594480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00010000:00010000:2.0:1787560510.601646:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.601664:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.601672:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.601679:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560510.601685:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.601693:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.601710:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27500) 00010000:00010000:2.0:1787560510.601713:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787560510.601717:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.601741:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f06b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560510.623162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560510.623308:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788255872 00000100:00100000:0.0:1787560510.623317:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788255872 00000100:00100000:0.0:1787560510.623379:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:0.0:1787560510.623390:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:9670:x1874392788255872:12345-192.168.201.56@tcp:101:chown.0 00010000:00010000:0.0:1787560510.623415:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560510.623439:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9229a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.623504:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f079 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.623517:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.623529:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560510.623596:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787560510.623600:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560510.623643:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.623674:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9229a expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.623691:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f079 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9229a expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.623714:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3c00) 00010000:00010000:0.0:1787560510.623717:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560510.623720:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980031800, rc 0) 00000100:00100000:0.0:1787560510.623783:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:9670:x1874392788255872:12345-192.168.201.56@tcp:101:chown.0 Request processed in 395us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560510.623790:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:3.0:1787560510.630307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560510.630444:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788256000 00000100:00100000:2.0:1787560510.630455:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788256000 00000100:00100000:2.0:1787560510.630522:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:2.0:1787560510.630533:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:9670:x1874392788256000:12345-192.168.201.56@tcp:101:chown.0 00010000:00010000:2.0:1787560510.630555:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560510.630576:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922a1 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630640:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f087 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630654:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f087 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630665:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f087 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630679:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f08e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630686:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f08e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630692:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f08e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630787:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630805:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630813:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560510.630891:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787560510.630895:0:6706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560510.630922:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630935:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f087 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630942:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f087 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630949:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f087 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630956:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4463400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560510.630960:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f087 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630968:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f087 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.630980:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3c00) 00010000:00010000:2.0:1787560510.630983:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560510.630988:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f087 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631004:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f087 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631018:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f08e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631025:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f08e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631031:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f08e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631037:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4462400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560510.631040:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f08e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631047:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f08e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631055:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93d987d52200) 00010000:00010000:2.0:1787560510.631057:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560510.631060:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f08e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631067:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f08e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631095:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922a1 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631109:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922a1 expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.631121:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:2.0:1787560510.631123:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560510.631126:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4463000, rc 0) 00000100:00100000:2.0:1787560510.631189:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:9670:x1874392788256000:12345-192.168.201.56@tcp:101:chown.0 Request processed in 658us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560510.631198:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:3.0:1787560510.635653:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560510.635766:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788256256 00000100:00100000:0.0:1787560510.635776:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788256256 00000100:00100000:0.0:1787560510.635883:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:0.0:1787560510.635894:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:9670:x1874392788256256:12345-192.168.201.56@tcp:36:chown.0 00010000:00010000:0.0:1787560510.635948:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560510.635974:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922a1 expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.635993:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:0.0:1787560510.636004:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560510.636030:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.636043:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.636052:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560510.684060:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787560510.684499:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b6b2835 reply state 000000004b905818 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560510.684514:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787560510.684735:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787560510.684903:0:5838:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787560510.684937:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:9670:x1874392788256256:12345-192.168.201.56@tcp:36:chown.0 Request processed in 49042us (49291us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787560510.684947:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00010000:00010000:1.0:1787560510.685028:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.685037:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.685045:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.685060:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560510.685064:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.685072:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.685088:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:1.0:1787560510.685091:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787560510.685109:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.685115:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f09c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560510.717057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560510.717903:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788256384 00000100:00100000:2.0:1787560510.717915:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788256384 00000100:00100000:2.0:1787560510.717987:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:2.0:1787560510.717996:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:9671:x1874392788256384:12345-192.168.201.56@tcp:101:touch.500 00010000:00010000:2.0:1787560510.718022:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560510.718041:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f0a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922a8 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787560510.719541:0:6706:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1451us 00010000:00010000:1.0:1787560510.732806:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f0aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.732829:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f0aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.732868:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f0aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.732884:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.732890:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.732907:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733599:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f0b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733610:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733618:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560510.733695:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787560510.733699:0:6706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560510.733799:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733812:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f0aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733819:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f0aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733826:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f0aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733832:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560510.733836:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f0aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733876:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f0aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733898:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3c00) 00010000:00010000:1.0:1787560510.733900:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560510.733904:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f0aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733909:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f0aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733920:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733925:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733930:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733935:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560510.733937:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733942:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733948:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93d995c27600) 00010000:00010000:1.0:1787560510.733950:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560510.733952:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.733957:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.734003:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463a00/0xe34191b05673f0a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922a8 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.734028:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922a8 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.734035:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d995c27800) 00010000:00010000:1.0:1787560510.734037:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787560510.734040:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260800, rc 0) 00000100:00100000:1.0:1787560510.734108:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:9671:x1874392788256384:12345-192.168.201.56@tcp:101:touch.500 Request processed in 16112us (17062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560510.734118:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:3.0:1787560510.737530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560510.737746:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788256640 00000100:00100000:2.0:1787560510.737756:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788256640 00000100:00100000:2.0:1787560510.737815:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:2.0:1787560510.737826:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:9671:x1874392788256640:12345-192.168.201.56@tcp:101:touch.500 00010000:00010000:2.0:1787560510.738079:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560510.738163:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f0bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.738613:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f0c6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.738628:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f0c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.738648:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f0c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.738678:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.738686:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.738693:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560510.739462:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787560510.739654:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f0d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739663:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739669:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739715:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f0c6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739722:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f0c6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739729:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f0c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739735:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4463400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560510.739746:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f0c6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739753:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f0c6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739765:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d995c27800) 00010000:00010000:2.0:1787560510.739768:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560510.739771:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f0c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739775:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463400/0xe34191b05673f0c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560510.739785:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041b3115e reply state 000000000cf916b2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560510.739791:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787560510.739823:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4462400/0xe34191b05673f0bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922af expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739874:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922af expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.739884:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93d987d52400) 00010000:00010000:2.0:1787560510.739887:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560510.739889:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710400, rc 0) 00000100:00100000:2.0:1787560510.739978:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:9671:x1874392788256640:12345-192.168.201.56@tcp:101:touch.500 Request processed in 2153us (2459us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787560510.739984:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00010000:00010000:1.0:1787560510.742954:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.742967:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.742971:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.742975:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4463000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560510.742978:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.742982:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.742996:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc6b52abd (ffff93d987d52200) 00010000:00010000:1.0:1787560510.743013:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560510.743019:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.743025:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4463000/0xe34191b05673f0cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560510.744896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560510.745229:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788256896 00000100:00100000:1.0:1787560510.745239:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788256896 00000100:00100000:1.0:1787560510.745343:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:1.0:1787560510.745354:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:9671:x1874392788256896:12345-192.168.201.56@tcp:36:touch.500 00010000:00010000:1.0:1787560510.745409:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560510.745435:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f0d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922af expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.745454:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93d987d52400) 00010000:00010000:1.0:1787560510.745463:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560510.745507:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.745519:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.745528:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560510.745662:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010c339ae reply state 000000000cc91402 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560510.745670:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560510.745772:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:9671:x1874392788256896:12345-192.168.201.56@tcp:36:touch.500 Request processed in 420us (887us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787560510.745789:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 23 00010000:00010000:2.0:1787560510.748769:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.748786:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.748793:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.748799:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560510.748805:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.748812:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.748828:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93d995c27600) 00010000:00010000:2.0:1787560510.748831:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560510.748836:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.748890:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f0e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560510.751546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560510.751819:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788257024 00000100:00100000:0.0:1787560510.751828:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788257024 00000100:00100000:0.0:1787560510.751949:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:0.0:1787560510.751959:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:9671:x1874392788257024:12345-192.168.201.56@tcp:101:touch.500 00010000:00010000:0.0:1787560510.751984:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560510.752015:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f0e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.752076:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f0e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922b6 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.752090:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f0e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922b6 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.752110:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:0.0:1787560510.752113:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560510.752116:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980030c00, rc 0) 00000100:00100000:0.0:1787560510.752178:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:9671:x1874392788257024:12345-192.168.201.56@tcp:101:touch.500 Request processed in 220us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560510.752186:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:1.0:1787560510.755351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560510.755431:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788257152 00000100:00100000:3.0:1787560510.755442:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788257152 00000100:00100000:3.0:1787560510.755488:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:3.0:1787560510.755497:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2341:x1874392788257152:12345-192.168.201.56@tcp:8:touch.500 00010000:00080000:3.0:1787560510.755526:0:8101:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1787560510.755558:0:8101:0:(genops.c:1385:class_connect()) connect: client 3e6b7760-d76b-45e8-8d98-861d14ecc789, cookie 0xe34191b05673f0f0 00002000:00100000:3.0:1787560510.755570:0:8101:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e6b7760-d76b-45e8-8d98-861d14ecc789/ffff93d9b38e6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787560510.755595:0:8101:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787560510.755816:0:8101:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787560510.755879:0:8101:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560510.755952:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2341:x1874392788257152:12345-192.168.201.56@tcp:8:touch.500 Request processed in 454us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560510.755960:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:3.0:1787560510.758660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560510.758756:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788257280 00000100:00100000:0.0:1787560510.758766:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788257280 00000100:00100000:0.0:1787560510.758875:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:0.0:1787560510.758885:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:0:x1874392788257280:12345-192.168.201.56@tcp:2:touch.500 00000100:00080000:1.0:1787560510.760029:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787560510.788995:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1787560510.789014:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000100:00100000:3.0:1787560510.789302:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:0:x1874392788257280:12345-192.168.201.56@tcp:2:touch.500 Request processed in 30412us (30644us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787560510.789314:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:1.0:1787560510.792622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560510.792705:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788257536 00000100:00100000:2.0:1787560510.792716:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788257536 00000100:00100000:2.0:1787560510.792777:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:2.0:1787560510.792787:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:9671:x1874392788257536:12345-192.168.201.56@tcp:35:touch.500 00000100:00100000:2.0:1787560510.793333:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:9671:x1874392788257536:12345-192.168.201.56@tcp:35:touch.500 Request processed in 545us (717us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787560510.793357:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:1.0:1787560510.807228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560510.807460:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788257664 00000100:00100000:2.0:1787560510.807470:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788257664 00000100:00100000:2.0:1787560510.807527:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:2.0:1787560510.807538:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:9672:x1874392788257664:12345-192.168.201.56@tcp:101:rm.0 00010000:00010000:2.0:1787560510.807563:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560510.807584:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f0f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922bd expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.807650:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b05673f0fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.807665:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b05673f0fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.807677:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b05673f0fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560510.807735:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787560510.807739:0:6706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560510.807809:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b05673f0fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.807887:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f0f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922bd expref: 13 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.807910:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b05673f0fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922bd expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.807932:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d995c27800) 00010000:00010000:2.0:1787560510.807935:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560510.807939:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710c00, rc 0) 00000100:00100000:2.0:1787560510.808005:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+12:9672:x1874392788257664:12345-192.168.201.56@tcp:101:rm.0 Request processed in 469us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560510.808012:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:3.0:1787560510.815247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560510.815449:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788257920 00000100:00100000:0.0:1787560510.815460:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788257920 00000100:00100000:0.0:1787560510.815519:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:0.0:1787560510.815531:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+12:9672:x1874392788257920:12345-192.168.201.56@tcp:101:rm.0 00010000:00010000:0.0:1787560510.815551:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560510.815587:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560510.815707:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787560510.815915:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f105 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922c4 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.815930:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3c00) 00010000:00010000:0.0:1787560510.815932:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560510.815938:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030800/0xe34191b05673f105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922c4 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.815952:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980030800, rc 0) 00000100:00100000:0.0:1787560510.816012:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:9672:x1874392788257920:12345-192.168.201.56@tcp:101:rm.0 Request processed in 483us (774us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787560510.816019:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:3.0:1787560510.821296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560510.821475:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788258048 00000100:00100000:1.0:1787560510.821486:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788258048 00000100:00100000:1.0:1787560510.821542:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:1.0:1787560510.821552:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:9672:x1874392788258048:12345-192.168.201.56@tcp:37:rm.0 00000100:00100000:2.0:1787560510.826950:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:9672:x1874392788258048:12345-192.168.201.56@tcp:37:rm.0 Request processed in 5388us (5654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560510.826963:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:3.0:1787560510.831573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560510.831624:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788258304 00000100:00100000:2.0:1787560510.831634:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788258304 00000100:00100000:2.0:1787560510.831690:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:2.0:1787560510.831700:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae747050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:9672:x1874392788258304:12345-192.168.201.56@tcp:35:rm.0 00000100:00100000:2.0:1787560510.832616:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae747050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:9672:x1874392788258304:12345-192.168.201.56@tcp:35:rm.0 Request processed in 912us (1046us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787560510.832626:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:3.0:1787560510.835606:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560510.835715:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788258560 00000100:00100000:2.0:1787560510.835725:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788258560 00000100:00100000:2.0:1787560510.835779:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:2.0:1787560510.835789:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:9672:x1874392788258560:12345-192.168.201.56@tcp:101:rm.0 00010000:00010000:2.0:1787560510.835817:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560510.835865:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922cb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.835992:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f11a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.836022:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f11a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.836034:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f11a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560510.836048:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787560510.836292:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922cb expref: 17 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.836313:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f11a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922cb expref: 16 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.836321:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d995c27800) 00010000:00010000:2.0:1787560510.836324:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787560510.836328:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711600, rc 0) 00000100:00100000:2.0:1787560510.836378:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:9672:x1874392788258560:12345-192.168.201.56@tcp:101:rm.0 Request processed in 591us (780us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787560510.836384:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:1.0:1787560510.843027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560510.843641:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788258688 00000100:00100000:3.0:1787560510.843653:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788258688 00000100:00100000:3.0:1787560510.843715:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:3.0:1787560510.843725:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:9672:x1874392788258688:12345-192.168.201.56@tcp:41:rm.0 00000004:00000024:3.0:1787560510.843783:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787560510.844029:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:9672:x1874392788258688:12345-192.168.201.56@tcp:41:rm.0 Request processed in 304us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560510.844037:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:1.0:1787560510.847081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560510.847459:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788258816 00000100:00100000:2.0:1787560510.847470:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788258816 00000100:00100000:2.0:1787560510.847576:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:2.0:1787560510.847587:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:9672:x1874392788258816:12345-192.168.201.56@tcp:101:rm.0 00010000:00010000:2.0:1787560510.847606:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560510.847625:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673f128 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922d2 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847710:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f12f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847724:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f12f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847735:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f12f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847749:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847756:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847763:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847899:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05673f13d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847908:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05673f13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847915:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05673f13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560510.847941:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787560510.847946:0:6706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560510.847961:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05673f13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847985:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05673f13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847993:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f12f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.847998:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f12f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848005:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f12f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848011:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560510.848014:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f12f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848022:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f12f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848035:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d995c27800) 00010000:00010000:2.0:1787560510.848039:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560510.848045:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f12f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848050:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f12f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848062:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848067:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f136 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848080:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848085:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560510.848087:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848217:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f136 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848227:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc6b52abd (ffff93d987d52b00) 00010000:00010000:2.0:1787560510.848229:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560510.848233:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f136 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848239:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848385:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673f128 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922d2 expref: 18 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848403:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05673f13d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922d2 expref: 17 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.848409:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:2.0:1787560510.848412:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560510.848414:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711400, rc 0) 00000100:00100000:2.0:1787560510.848529:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:9672:x1874392788258816:12345-192.168.201.56@tcp:101:rm.0 Request processed in 943us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560510.848547:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:1.0:1787560510.852480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560510.852555:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788259072 00000100:00100000:2.0:1787560510.852565:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788259072 00000100:00100000:2.0:1787560510.852619:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:2.0:1787560510.852630:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:9672:x1874392788259072:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:2.0:1787560510.852687:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787560510.852713:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05673f13d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922d2 expref: 17 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.852735:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f0e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922b6 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.852746:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:2.0:1787560510.852762:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b05673f0fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922bd expref: 15 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.852773:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d995c27800) 00010000:00010000:2.0:1787560510.852776:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560510.852795:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f144 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.852808:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f144 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.852818:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f144 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.852832:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.852893:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.852900:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.853047:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f152 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.853055:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.853062:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560510.854587:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787560510.854602:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339607754003ns, next at 340607751458ns, rc = 0 00010000:00010000:2.0:1787560510.854677:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854691:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854700:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854708:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854713:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854731:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854813:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787560510.854834:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f152 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854896:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f152 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854902:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f152 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854907:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560510.854911:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f152 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854917:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f152 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854929:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93d987d52400) 00010000:00010000:2.0:1787560510.854932:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787560510.854936:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f152 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854941:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f152 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854962:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f144 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854968:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f144 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854981:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f144 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854986:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560510.854989:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f144 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.854997:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f144 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.855007:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d995c27800) 00010000:00010000:2.0:1787560510.855010:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560510.855013:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f144 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560510.855020:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f144 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560510.855034:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d77dc6fa reply state 000000004ea4740f transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560510.855044:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560510.855333:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:9672:x1874392788259072:12345-192.168.201.56@tcp:36:rm.0 Request processed in 2701us (2860us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787560510.855342:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00010000:00010000:1.0:1787560510.860062:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560510.860075:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.860086:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711200 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560510.860090:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.860111:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.860129:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff93d987d52400) 00010000:00010000:1.0:1787560510.860141:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787560510.860147:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.860167:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f159 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.860191:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560510.860193:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560510.860195:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560510.860301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560510.860356:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788259328 00000100:00100000:1.0:1787560510.860368:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788259328 00000100:00100000:1.0:1787560510.860418:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:1.0:1787560510.860429:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:9672:x1874392788259328:12345-192.168.201.56@tcp:35:rm.0 00010000:00010000:0.0:1787560510.861524:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.861537:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.861544:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.861549:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560510.861554:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.861560:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.861589:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc6b52abd (ffff93d987d52000) 00010000:00010000:0.0:1787560510.861592:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560510.861596:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.861603:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f14b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560510.861710:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:9672:x1874392788259328:12345-192.168.201.56@tcp:35:rm.0 Request processed in 1279us (1408us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787560510.861720:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:3.0:1787560510.864448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560510.866472:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788259584 00000100:00100000:1.0:1787560510.866486:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788259584 00000100:00100000:1.0:1787560510.866587:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:1.0:1787560510.866598:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:9672:x1874392788259584:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:1.0:1787560510.866660:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787560510.866687:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f11a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922cb expref: 16 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.866708:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f0b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922a8 expref: 15 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.866718:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d995c27800) 00010000:00010000:1.0:1787560510.866733:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f079 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9229a expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.866759:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3c00) 00010000:00010000:1.0:1787560510.866766:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560510.866789:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f160 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.866801:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f160 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.866809:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f160 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.866820:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.866825:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.866831:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867177:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f16e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867186:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f16e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867192:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f16e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560510.867809:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787560510.867825:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f16e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867874:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f16e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867881:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f16e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867887:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560510.867892:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f16e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867898:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f16e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867909:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff93d995c27600) 00010000:00010000:1.0:1787560510.867912:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787560510.867916:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f16e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867921:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f16e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867942:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f160 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867947:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f160 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867953:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f160 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867956:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560510.867965:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f160 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867970:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f160 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867979:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27c00) 00010000:00010000:1.0:1787560510.867981:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560510.867984:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f160 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560510.867990:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f160 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560510.868002:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bc0e5ad reply state 00000000683a7620 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560510.868010:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560510.868098:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:9672:x1874392788259584:12345-192.168.201.56@tcp:36:rm.0 Request processed in 1499us (3656us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787560510.868107:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 31 00010000:00010000:0.0:1787560510.872675:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.872691:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.872699:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.872704:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560510.872708:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.872715:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.872731:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff93d995c27a00) 00010000:00010000:0.0:1787560510.872734:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560510.872739:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560510.872745:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f167 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560511.250195:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560511.695554:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560511.698919:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560511.698950:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815556096:0@lo:400:kworker.0 00000100:00100000:2.0:1787560511.699035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.699303:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815555840:0@lo:400:kworker.0 00000100:00100000:2.0:1787560511.699346:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.699369:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560511.699375:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815555968:0@lo:400:kworker.0 00000100:00100000:2.0:1787560511.699398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.699432:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815555840 00000100:00100000:2.0:1787560511.699440:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815555840 00000100:00100000:2.0:1787560511.699479:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815555968 00000100:00100000:2.0:1787560511.699483:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815555968 00000100:00100000:2.0:1787560511.699522:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787560511.699531:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815555840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560511.699582:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815555840:12345-0@lo:400:kworker.0 Request processed in 52us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.699589:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787560511.699607:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787560511.699612:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815555968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560511.699643:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815555968:12345-0@lo:400:kworker.0 Request processed in 31us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.699648:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787560511.699685:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815555968:0@lo:400:kworker.0 00000100:00100000:2.0:1787560511.699696:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815555840:0@lo:400:kworker.0 00000100:00100000:3.0:1787560511.699862:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815556096 00000100:00100000:3.0:1787560511.699874:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815556096 00000100:00100000:3.0:1787560511.699914:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787560511.699921:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815556096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560511.699962:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815556096:12345-0@lo:400:kworker.0 Request processed in 42us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560511.699968:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1787560511.699998:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b451ad80 x1874392815556096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560511.700010:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815556096:0@lo:400:kworker.0 00000100:00100000:3.0:1787560511.700027:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b451b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815555712:0@lo:400:kworker.0 00000100:00100000:3.0:1787560511.700059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560511.700081:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815555712 00000100:00100000:3.0:1787560511.700084:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815555712 00000100:00100000:3.0:1787560511.700109:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787560511.700115:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815555712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560511.700143:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815555712:12345-0@lo:400:kworker.0 Request processed in 28us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560511.700149:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787560511.700185:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b451b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815555712:0@lo:400:kworker.0 00000100:00080000:0.0:1787560511.701760:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560511.701769:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560511.705493:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815556224:0@lo:400:kworker.0 00000100:00100000:1.0:1787560511.705564:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.706071:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815556224 00000100:00100000:2.0:1787560511.706080:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815556224 00000100:00100000:2.0:1787560511.706152:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787560511.706162:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815556224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560511.706221:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815556224:12345-0@lo:400:kworker.0 Request processed in 62us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.706237:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787560511.706262:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815556352:0@lo:400:kworker.0 00000100:00100000:2.0:1787560511.706293:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560511.706345:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815556224:0@lo:400:kworker.0 00000100:00100000:2.0:1787560511.706367:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815556352 00000100:00100000:2.0:1787560511.706370:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815556352 00000100:00100000:2.0:1787560511.706396:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787560511.706403:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815556352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560511.706435:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815556352:12345-0@lo:400:kworker.0 Request processed in 33us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560511.706441:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787560511.706469:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b451ad80 x1874392815556352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560511.706480:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815556352:0@lo:400:kworker.0 00000100:00080000:0.0:1787560511.706539:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560511.706544:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560512.207241:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560512.207268:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815556480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560512.207342:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560512.207466:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815556480 00000100:00100000:0.0:1787560512.207476:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815556480 00000100:00100000:0.0:1787560512.207533:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787560512.207543:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815556480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560512.207579:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560512.207631:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815556480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560512.207640:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787560512.207889:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a6a00 x1874392815556480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560512.207910:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815556480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787560512.273254:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560513.296325:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560514.320289:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560514.484383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560514.484431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560514.484495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560514.484545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560514.484581:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788259840 00000100:00100000:3.0:1787560514.484590:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788259840 00000100:00100000:3.0:1787560514.484644:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788260096 00000100:00100000:3.0:1787560514.484647:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788260096 00000100:00100000:3.0:1787560514.484669:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:3.0:1787560514.484679:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:2342:x1874392788259840:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560514.484749:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:2342:x1874392788259840:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560514.484757:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:3.0:1787560514.484782:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 105 00000100:00100000:3.0:1787560514.484800:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788260096:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560514.484892:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788260096:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 104us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560514.484898:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 105 00000100:00100000:0.0:1787560514.485379:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788259968 00000100:00100000:0.0:1787560514.485386:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788259968 00000100:00100000:1.0:1787560514.485423:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788259712 00000100:00100000:1.0:1787560514.485429:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788259712 00000100:00100000:0.0:1787560514.485459:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:1.0:1787560514.485471:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 250 00000100:00100000:0.0:1787560514.485473:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788259968:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560514.485484:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788259712:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560514.485512:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788259968:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 45us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560514.485519:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:1.0:1787560514.485525:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788259712:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 44us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560514.485533:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 250 00000100:00080000:0.0:1787560514.485542:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560514.485548:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560514.767950:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560514.767979:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815556608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560514.768840:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787560514.768974:0:6860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343522125981ns, next at 344522123246ns, rc = 0 00000100:00100000:0.0:1787560514.769056:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815556608 00000100:00100000:0.0:1787560514.769067:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815556608 00000100:00100000:0.0:1787560514.769176:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787560514.769190:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815556608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560514.769236:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560514.769300:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815556608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560514.769309:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787560514.769369:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9baf37800 x1874392815556608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560514.769399:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815556608:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560514.770143:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787560515.260546:0:11610:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787560515.352378:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787560515.857379:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:1.0:1787560515.857399:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1787560515.857409:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1787560515.857802:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787560515.858685:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815556736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787560515.858773:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560515.858910:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815556736 00000100:00100000:3.0:1787560515.858918:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815556736 00000100:00100000:3.0:1787560515.858968:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560515.858977:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815556736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787560515.859003:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787560515.859044:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c023e, atime: 0x6a8c023e, ctime: 0x6a8c023e, blocks: 0x1 00010000:00010000:3.0:1787560515.859059:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef1e1d0a/0xe34191b05673f175 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.859074:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1787560515.859078:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560515.859083:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1e1d0a/0xe34191b05673f175 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.859425:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef1e1d0a/0xe34191b05673f175 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.859438:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef1e1d0a/0xe34191b05673f175 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.859446:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1e1d0a/0xe34191b05673f175 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560515.859464:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787560515.860056:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874392815556736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1077us (1282us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787560515.860065:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1787560515.860589:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d998b70e00/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787560515.860597:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815556736:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787560515.861041:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560515.861050:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef1e1d0a/0xe34191b05673f175 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.861062:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c5400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560515.861067:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef1e1d0a/0xe34191b05673f175 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.861076:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef1e1d0a/0xe34191b05673f175 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.861099:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef1e1d0a/0xe34191b05673f175 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.861107:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef1e1d0a/0xe34191b05673f175 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560515.861130:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560515.861132:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560515.861134:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787560516.246164:0:11660:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea4c63780 20000000:00000080:0.0:1787560516.246189:0:11660:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d9b426f000 uarg=0000000000000000 20000000:01000000:0.0:1787560516.246226:0:11660:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787560516.246232:0:11660:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787560516.246237:0:11660:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787560516.247300:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787560516.247481:0:11660:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787560516.253365:0:11660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787560516.253428:0:11660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787560516.253499:0:11660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787560516.253519:0:11660:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787560516.253658:0:11660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.253677:0:11660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4463600/0xe34191b05673f01e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673f017 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.253684:0:11660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4261400/0xe34191b05673f02c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673f025 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.253690:0:11660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f03a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673f033 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.253700:0:11660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92285 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.253706:0:11660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4261000/0xe34191b05673f048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9228c expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.253713:0:11660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.253764:0:11660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4261000/0xe34191b05673f048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9228c expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.253791:0:11660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9b4261000/0xe34191b05673f048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9228c expref: 12 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.253806:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1874392815556864:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560516.254087:0:11660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92285 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.254097:0:11660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f041 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92285 expref: 12 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.254105:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1874392815556992:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560516.254135:0:11660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673f033 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.254142:0:11660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f03a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673f033 expref: 18 pid: 5832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.254151:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1874392815557120:0@lo:104: 00000100:00100000:0.0:1787560516.254190:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560516.254224:0:11660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4261400/0xe34191b05673f02c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673f025 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.254232:0:11660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9b4261400/0xe34191b05673f02c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673f025 expref: 18 pid: 5832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.254241:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1874392815557248:0@lo:104: 00000100:00100000:0.0:1787560516.254262:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560516.254298:0:11660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4463600/0xe34191b05673f01e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05673f017 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.254306:0:11660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93d9b4463600/0xe34191b05673f01e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05673f017 expref: 18 pid: 5831 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560516.254315:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1874392815557376:0@lo:104: 00000100:00100000:0.0:1787560516.254343:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560516.254353:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38fae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560516.254897:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787560516.254911:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815557120 00000100:00100000:1.0:1787560516.254918:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815557120 00000100:00100000:1.0:1787560516.254956:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815557248 00000100:00100000:1.0:1787560516.254959:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815557248 00000100:00100000:1.0:1787560516.254969:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815557376 00000100:00100000:1.0:1787560516.254972:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815557376 00000100:00100000:1.0:1787560516.254983:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787560516.254991:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:11660:x1874392815557120:12345-0@lo:104: 00010000:00010000:1.0:1787560516.255017:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255079:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787560516.255086:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+5:11660:x1874392815557120:12345-0@lo:104: Request processed in 95us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560516.255093:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787560516.255109:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560516.255116:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:11660:x1874392815557248:12345-0@lo:104: 00010000:00010000:1.0:1787560516.255123:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255173:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787560516.255178:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+4:11660:x1874392815557248:12345-0@lo:104: Request processed in 64us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560516.255185:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560516.255199:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560516.255205:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3876850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:11660:x1874392815557376:12345-0@lo:104: 00010000:00010000:1.0:1787560516.255212:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255246:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787560516.255251:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3876850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+3:11660:x1874392815557376:12345-0@lo:104: Request processed in 47us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560516.255257:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787560516.255294:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787560516.255301:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255308:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4463e00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560516.255312:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255320:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560516.255328:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560516.255334:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560516.255369:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255376:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560516.255398:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255405:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9b4463e00/0xe34191b05673f033 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673f03a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255419:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560516.255422:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255428:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261c00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560516.255431:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255438:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560516.255443:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560516.255449:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560516.255461:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255466:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560516.255472:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255488:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9b4261c00/0xe34191b05673f025 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673f02c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255497:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560516.255500:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255506:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980031a00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560516.255509:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255515:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.255739:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1787560516.255779:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560516.255786:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560516.255801:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.255806:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787560516.255861:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815557760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560516.255898:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560516.256030:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1874392815557120:0@lo:104: 00000100:00100000:0.0:1787560516.256041:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1874392815557248:0@lo:104: 00000100:00100000:0.0:1787560516.256047:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1874392815557376:0@lo:104: 00010000:00010000:1.0:1787560516.256105:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.256113:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f017 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b05673f01e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.256127:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560516.256134:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560516.256136:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560516.256142:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560516.256153:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815557504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560516.256180:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560516.256203:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560516.256209:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815557632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560516.256232:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560516.256264:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815557760 00000100:00100000:1.0:1787560516.256268:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815557760 00010000:00010000:1.0:1787560516.256291:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4463600/0xe34191b05673f01e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673f017 expref: 19 pid: 5831 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560516.256313:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815557504 00000100:00100000:1.0:1787560516.256316:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815557504 00010000:00010000:1.0:1787560516.256327:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f03a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673f033 expref: 20 pid: 5832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560516.256337:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815557632 00000100:00100000:1.0:1787560516.256340:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815557632 00010000:00010000:1.0:1787560516.256349:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4261400/0xe34191b05673f02c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673f025 expref: 21 pid: 5832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560516.256362:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787560516.256369:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+21:3311:x1874392815557760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560516.256380:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560516.256386:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4463600/0xe34191b05673f01e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673f017 expref: 21 pid: 5831 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.256396:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4463600/0xe34191b05673f01e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673f017 expref: 21 pid: 5831 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.256418:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4463600/0xe34191b05673f01e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673f017 expref: 21 pid: 5831 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.256430:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560516.257240:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+20:3311:x1874392815557760:12345-0@lo:103:ldlm_bl.0 Request processed in 868us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560516.257249:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787560516.257270:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787560516.257278:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815557504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560516.257289:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560516.257295:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f03a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673f033 expref: 19 pid: 5832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.257305:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673f033 expref: 19 pid: 5832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.257317:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4462c00/0xe34191b05673f03a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673f033 expref: 19 pid: 5832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.257327:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560516.257587:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:3313:x1874392815557504:12345-0@lo:103:ldlm_bl.0 Request processed in 310us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560516.257594:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787560516.257608:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787560516.257616:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:3313:x1874392815557632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560516.257623:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560516.257629:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4261400/0xe34191b05673f02c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05673f025 expref: 17 pid: 5832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.257645:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4261400/0xe34191b05673f02c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05673f025 expref: 17 pid: 5832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.257655:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4261400/0xe34191b05673f02c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05673f025 expref: 17 pid: 5832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560516.257663:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560516.257686:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3313:x1874392815557632:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560516.257691:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787560516.259141:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815557760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560516.259435:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815557504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560516.259453:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815557632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560516.259731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560516.259768:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560516.259880:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1874392815556864:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560516.259890:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11660:1874392815556992:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560516.259923:0:11660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.260129:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788260224 00000100:00100000:3.0:1787560516.260144:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788260224 00010000:00010000:3.0:1787560516.260176:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4261000/0xe34191b05673f048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9228c expref: 13 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.260208:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788260352 00000100:00100000:3.0:1787560516.260211:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788260352 00010000:00010000:3.0:1787560516.260226:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f041 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92285 expref: 14 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560516.260247:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:3.0:1787560516.260256:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+14:2342:x1874392788260224:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560516.260268:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560516.260274:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4261000/0xe34191b05673f048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9228c expref: 14 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260284:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4261000/0xe34191b05673f048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9228c expref: 14 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260300:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4261000/0xe34191b05673f048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9228c expref: 14 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260314:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560516.260361:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788260224:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 106us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.260368:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:3.0:1787560516.260384:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:3.0:1787560516.260390:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+12:2342:x1874392788260352:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560516.260398:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560516.260403:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f041 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92285 expref: 12 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260419:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92285 expref: 12 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260429:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f041 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92285 expref: 12 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260440:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260449:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260472:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260479:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260486:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260493:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260499:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030800 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560516.260503:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260511:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260547:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.260557:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560516.260576:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+11:2342:x1874392788260352:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 186us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560516.260583:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 34 00010000:00010000:0.0:1787560516.260767:0:11660:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.260775:0:11660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560516.260780:0:11660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980030800/0xe34191b05673f17c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560516.367443:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560516.815528:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815557888:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.815606:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560516.815673:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815558400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.815700:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560516.815729:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560516.815747:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815558272:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.815771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560516.815879:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815558016:0@lo:400:kworker.0 00000100:00100000:1.0:1787560516.815908:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560516.815927:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560516.815932:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815558144:0@lo:400:kworker.0 00000100:00100000:1.0:1787560516.815953:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560516.815986:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815558400 00000100:00100000:1.0:1787560516.815993:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815558400 00000100:00100000:1.0:1787560516.816039:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815558144 00000100:00100000:1.0:1787560516.816058:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815558144 00000100:00100000:1.0:1787560516.816084:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787560516.816108:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815558400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560516.816334:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815558400:12345-0@lo:400:kworker.0 Request processed in 228us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560516.816342:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787560516.816359:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787560516.816366:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815558144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560516.816403:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815558144:12345-0@lo:400:kworker.0 Request processed in 38us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560516.816424:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787560516.816442:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560516.816445:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560516.816474:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815558144:0@lo:400:kworker.0 00010000:00080000:1.0:1787560516.816500:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a4700 x1874392815558400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560516.816510:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815558400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.816668:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815557888 00000100:00100000:2.0:1787560516.816672:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815557888 00000100:00100000:2.0:1787560516.816706:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815558272 00000100:00100000:2.0:1787560516.816709:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815558272 00000100:00100000:2.0:1787560516.816729:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815558016 00000100:00100000:2.0:1787560516.816741:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815558016 00000100:00100000:2.0:1787560516.816758:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787560516.816764:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815557888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.816803:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815557888:12345-0@lo:400:kworker.0 Request processed in 39us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560516.816808:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787560516.816821:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787560516.816827:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815558272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.816877:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815558272:12345-0@lo:400:kworker.0 Request processed in 49us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560516.816882:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787560516.816891:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787560516.816896:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815558016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.816920:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815558016:12345-0@lo:400:kworker.0 Request processed in 24us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560516.816933:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1787560516.816945:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560516.816963:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815558272:0@lo:400:kworker.0 00000100:00100000:2.0:1787560516.816974:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815557888:0@lo:400:kworker.0 00000100:00100000:0.0:1787560516.817534:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815558016:0@lo:400:kworker.0 00000100:00100000:1.0:1787560517.327344:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815558528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560517.327419:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560517.329102:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815558528 00000100:00100000:0.0:1787560517.329114:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815558528 00000100:00100000:0.0:1787560517.329178:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787560517.329189:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815558528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560517.329227:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560517.329311:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815558528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.329318:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787560517.329442:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a5880 x1874392815558528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560517.329464:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815558528:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560517.391059:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787560517.774978:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560517.774986:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9bfc6d000 from 7 10000000:01000000:0.0:1787560517.774991:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560517.775051:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.775064:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.775076:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560517.775102:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815558656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.775190:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560517.775363:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38fae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560517.775398:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815558656 00000100:00100000:3.0:1787560517.775414:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815558656 00000100:00100000:3.0:1787560517.775497:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787560517.775510:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:5836:x1874392815558656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560517.775533:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560517.775555:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f18a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673f183 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.775590:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f18a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673f183 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.775604:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f18a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673f183 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.775615:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9829c5a00, rc 0) 00000100:00100000:3.0:1787560517.775700:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815558656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.775711:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787560517.775789:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815558656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560517.775815:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.775841:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560517.775924:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815558784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.775958:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560517.776027:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815558784 00000100:00100000:3.0:1787560517.776034:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815558784 00000100:00100000:3.0:1787560517.776076:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787560517.776082:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815558784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560517.776386:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815558784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.776394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787560517.777399:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38fae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560517.777430:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815558784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.777479:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815558912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.777542:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560517.777578:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38fae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560517.777660:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815558912 00000100:00100000:3.0:1787560517.777667:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815558912 00000100:00100000:3.0:1787560517.777765:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787560517.778063:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815558912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560517.778499:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815558912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 723us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.778507:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787560517.778597:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815558912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.780296:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11673:1874392815559040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560517.780366:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560517.780408:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560517.780463:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815559040 00000100:00100000:2.0:1787560517.780470:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815559040 00000100:00100000:2.0:1787560517.780512:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787560517.780522:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:11673:x1874392815559040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560517.780731:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:11673:x1874392815559040:12345-0@lo:502:llog_process_th.0 Request processed in 210us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560517.780740:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787560517.790041:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11673:1874392815559040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560517.790102:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560517.790116:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560517.790119:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787560517.790126:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d9bfc6d000 00000020:00000080:0.0:1787560517.790129:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787560517.790235:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11673:1874392815559168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560517.790307:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560517.790355:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38faf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560517.790660:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815559168 00000100:00100000:3.0:1787560517.790667:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815559168 00000100:00100000:3.0:1787560517.790773:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787560517.790783:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:11673:x1874392815559168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560517.791014:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:11673:x1874392815559168:12345-0@lo:502:llog_process_th.0 Request processed in 232us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.791022:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787560517.791321:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11673:1874392815559168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560517.791355:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560517.791361:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560517.791363:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787560517.791367:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787560517.791519:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787560517.791539:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560517.791549:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.791560:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560517.791571:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560517.791574:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d986ace800 from 7 10000000:01000000:0.0:1787560517.791577:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560517.791602:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.791611:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560517.791620:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560517.791636:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815559296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.791668:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560517.810211:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38faf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560517.811770:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815559296 00000100:00100000:2.0:1787560517.811784:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815559296 00000100:00100000:2.0:1787560517.811835:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787560517.811845:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:5836:x1874392815559296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560517.811871:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560517.811889:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98a711400/0xe34191b05673f198 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673f191 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560517.811913:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98a711400/0xe34191b05673f198 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673f191 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560517.811936:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98a711400/0xe34191b05673f198 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673f191 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560517.811944:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711400, rc 0) 00000100:00100000:2.0:1787560517.812015:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815559296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (20346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560517.812022:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787560517.812278:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815559296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560517.812301:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560517.812311:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560517.812380:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815559424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560517.812414:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560517.812441:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98a775780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560517.812454:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815559424 00000100:00100000:2.0:1787560517.812458:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815559424 00000100:00100000:2.0:1787560517.812478:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787560517.812485:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815559424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560517.812734:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815559424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560517.812742:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787560517.812772:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815559424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560517.812809:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815559552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560517.814369:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560517.814483:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98a775780 going to sleep for 11 seconds 00000100:00100000:3.0:1787560517.818909:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815559552 00000100:00100000:3.0:1787560517.818923:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815559552 00000100:00100000:3.0:1787560517.818981:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787560517.818991:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815559552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560517.821480:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815559552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2481us (8624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.821494:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787560517.821608:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815559552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560517.821843:0:11677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11677:1874392815559680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560517.821910:0:11677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560517.821937:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815559680 00000100:00100000:3.0:1787560517.821944:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815559680 00000100:00100000:3.0:1787560517.821976:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787560517.821984:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:11677:x1874392815559680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560517.822164:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:11677:x1874392815559680:12345-0@lo:502:llog_process_th.0 Request processed in 180us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.822171:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787560517.822212:0:11677:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560517.822225:0:11677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11677:1874392815559680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787560517.822248:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560517.822256:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560517.822259:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787560517.822266:0:11677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d986ace800 00000020:00000080:3.0:1787560517.822268:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787560517.822677:0:11677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11677:1874392815559808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560517.822725:0:11677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560517.822747:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815559808 00000100:00100000:3.0:1787560517.822751:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815559808 00000100:00100000:3.0:1787560517.822774:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787560517.822780:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:11677:x1874392815559808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560517.822916:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:11677:x1874392815559808:12345-0@lo:502:llog_process_th.0 Request processed in 136us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.822922:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787560517.822952:0:11677:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560517.822962:0:11677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11677:1874392815559808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787560517.822981:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560517.822986:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560517.822987:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787560517.822991:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787560517.823043:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787560517.823059:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787560517.823069:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.823079:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560517.823088:0:5836:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787560517.823091:0:5836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d982bfc800 from 7 10000000:01000000:3.0:1787560517.823094:0:5836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787560517.823114:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.823121:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.823130:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560517.823142:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815559936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560517.823164:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560517.823176:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560517.823186:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815559936 00000100:00100000:3.0:1787560517.823194:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815559936 00000100:00100000:3.0:1787560517.823209:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787560517.823215:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:5836:x1874392815559936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560517.823222:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560517.823233:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9829c5e00/0xe34191b05673f1a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673f19f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.823250:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9829c5e00/0xe34191b05673f1a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673f19f expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.823259:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9829c5e00/0xe34191b05673f1a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673f19f expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.823267:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9829c5e00, rc 0) 00000100:00100000:3.0:1787560517.823291:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815559936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.823297:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787560517.823322:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815559936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560517.823333:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560517.823342:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560517.823375:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815560064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560517.823396:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560517.823407:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560517.823416:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815560064 00000100:00100000:3.0:1787560517.823424:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815560064 00000100:00100000:3.0:1787560517.823444:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787560517.823450:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815560064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560517.825330:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815560064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1872us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.825344:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000040:00080000:1.0:1787560517.827959:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787560517.830286:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815560064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560517.830351:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987359c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815560192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560517.830418:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560517.830462:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98a775780 going to sleep for 11 seconds 00000100:00100000:3.0:1787560517.835608:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815560192 00000100:00100000:3.0:1787560517.835623:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815560192 00000100:00100000:3.0:1787560517.835684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787560517.835694:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815560192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560517.835958:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:5836:x1874392815560192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (5540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.835966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787560517.839953:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987359c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ba37d386-11cd-48cd-b42f-22b3cfa8191f:5836:1874392815560192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560517.840292:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987359c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11678:1874392815560320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560517.840366:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560517.840398:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98a7759c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560517.840460:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815560320 00000100:00100000:3.0:1787560517.840466:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815560320 00000100:00100000:3.0:1787560517.840514:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787560517.840525:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:11678:x1874392815560320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560517.840746:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:11678:x1874392815560320:12345-0@lo:502:llog_process_th.0 Request processed in 222us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.840754:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787560517.841274:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987359c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11678:1874392815560320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560517.841303:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560517.841313:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560517.841315:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787560517.841324:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d982bfc800 00000020:00000080:2.0:1787560517.841327:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787560517.841414:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987359c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11678:1874392815560448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560517.841453:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560517.841480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815560448 00000100:00100000:2.0:1787560517.841485:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815560448 00000100:00100000:2.0:1787560517.841512:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787560517.841520:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:11678:x1874392815560448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560517.841666:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:11678:x1874392815560448:12345-0@lo:502:llog_process_th.0 Request processed in 146us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560517.841679:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787560517.841731:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560517.841744:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987359c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ba37d386-11cd-48cd-b42f-22b3cfa8191f:11678:1874392815560448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560517.841761:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560517.841765:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560517.841767:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787560517.841771:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787560517.841820:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787560517.841844:0:5836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560517.841876:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560517.841886:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560517.938277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560517.938362:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788260480 00000100:00100000:2.0:1787560517.938372:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788260480 00000100:00100000:2.0:1787560517.938441:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 266 00000100:00100000:2.0:1787560517.938451:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+11:5587:x1874392788260480:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560517.938467:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560517.938485:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98a710c00/0xe34191b05673f1ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922d9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560517.938512:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98a710c00/0xe34191b05673f1ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922d9 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560517.938523:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98a710c00/0xe34191b05673f1ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922d9 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560517.938551:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710c00, rc 0) 00000100:00100000:2.0:1787560517.938613:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788260480:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 163us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560517.938620:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 266 00000100:00100000:1.0:1787560517.952361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560517.952468:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788260608 00000100:00100000:3.0:1787560517.952486:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788260608 00000100:00100000:3.0:1787560517.952571:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 267 00000100:00100000:3.0:1787560517.952582:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788260608:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560517.953390:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788260608:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 807us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.953409:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 267 00000100:00100000:3.0:1787560517.959640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560517.961550:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788260736 00000100:00100000:0.0:1787560517.961570:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788260736 00000100:00100000:0.0:1787560517.961657:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 268 00000100:00100000:0.0:1787560517.962790:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788260736:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560517.964594:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788260736:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 Request processed in 2887us (4946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560517.964609:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 268 00000100:00100000:2.0:1787560517.986507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560517.987840:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788260864 00000100:00100000:3.0:1787560517.987883:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788260864 00000100:00100000:3.0:1787560517.987977:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 269 00000100:00100000:3.0:1787560517.987991:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+12:9942:x1874392788260864:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560517.991056:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+12:9942:x1874392788260864:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 3053us (5745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560517.991074:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 269 00000100:00100000:1.0:1787560518.007150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560518.009944:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788260992 00000100:00100000:0.0:1787560518.009965:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788260992 00000100:00100000:0.0:1787560518.010086:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 270 00000100:00100000:0.0:1787560518.010101:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+12:9942:x1874392788260992:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560518.010496:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+12:9942:x1874392788260992:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 397us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560518.010505:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 270 00000100:00100000:2.0:1787560518.023801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560518.024477:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788261120 00000100:00100000:3.0:1787560518.024493:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788261120 00000100:00100000:3.0:1787560518.024567:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 271 00000100:00100000:3.0:1787560518.024579:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+12:5587:x1874392788261120:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560518.024600:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560518.024623:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9829c5200/0xe34191b05673f1b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922e0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560518.024658:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9829c5200/0xe34191b05673f1b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922e0 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560518.024671:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9829c5200/0xe34191b05673f1b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922e0 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560518.024683:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9829c5200, rc 0) 00000100:00100000:3.0:1787560518.028265:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:5587:x1874392788261120:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 3667us (4459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560518.028311:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 271 00000100:00100000:3.0:1787560518.038504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560518.043459:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788261248 00000100:00100000:2.0:1787560518.043485:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788261248 00000100:00100000:2.0:1787560518.043585:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 272 00000100:00100000:2.0:1787560518.043598:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:5587:x1874392788261248:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560518.044083:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:5587:x1874392788261248:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 486us (5594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560518.044094:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 272 00000100:00100000:1.0:1787560518.055484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560518.058147:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788261376 00000100:00100000:0.0:1787560518.058169:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788261376 00000100:00100000:0.0:1787560518.058845:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 273 00000100:00100000:0.0:1787560518.058934:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:5587:x1874392788261376:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560518.060647:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:5587:x1874392788261376:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 Request processed in 1712us (5171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560518.060658:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 273 00000100:00100000:3.0:1787560518.067706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560518.068599:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788261504 00000100:00100000:2.0:1787560518.068614:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788261504 00000100:00100000:3.0:1787560518.068900:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 274 00000100:00100000:3.0:1787560518.068917:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:9945:x1874392788261504:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560518.070736:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:9945:x1874392788261504:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 1814us (3033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560518.070752:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 274 00000100:00100000:3.0:1787560518.079434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560518.087652:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788261632 00000100:00100000:0.0:1787560518.087686:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788261632 00000100:00100000:0.0:1787560518.087883:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 275 00000100:00100000:0.0:1787560518.087897:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:9945:x1874392788261632:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560518.088551:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:9945:x1874392788261632:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 654us (9130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560518.088572:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 275 00010000:00010000:1.0:1787560518.415265:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560518.864063:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560519.443354:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560519.603436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560519.603535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560519.603570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560519.603642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560519.603695:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788261888 00000100:00100000:1.0:1787560519.603705:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788261888 00000100:00100000:1.0:1787560519.603769:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788262144 00000100:00100000:1.0:1787560519.603772:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788262144 00000100:00100000:1.0:1787560519.603810:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 109 00000100:00100000:1.0:1787560519.603821:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788261888:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560519.603926:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788261888:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 106us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560519.603935:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 109 00000100:00100000:1.0:1787560519.603965:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 110 00000100:00100000:1.0:1787560519.603972:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788262144:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560519.604023:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788262144:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 41us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560519.604031:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 110 00000100:00080000:1.0:1787560519.604049:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560519.605636:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788262016 00000100:00100000:2.0:1787560519.605647:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788262016 00000100:00100000:2.0:1787560519.605729:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:2.0:1787560519.605739:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788262016:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560519.606350:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788262016:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 244us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560519.606360:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00080000:1.0:1787560519.606572:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560519.608073:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788261760 00000100:00100000:3.0:1787560519.608086:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788261760 00000100:00100000:3.0:1787560519.608145:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 276 00000100:00100000:3.0:1787560519.608154:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788261760:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560519.608224:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788261760:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 71us (4799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560519.608231:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 276 00000100:00100000:3.0:1787560519.887873:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560519.887897:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815560576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560519.887969:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560519.888212:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815560576 00000100:00100000:2.0:1787560519.888222:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815560576 00000100:00100000:2.0:1787560519.888287:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787560519.888310:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815560576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560519.888346:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560519.888390:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815560576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560519.888397:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787560519.888525:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560519.888561:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815560576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787560520.465547:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787560520.945426:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1787560521.487202:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560521.936425:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815561088:0@lo:400:kworker.0 00000100:00100000:1.0:1787560521.936503:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560521.936568:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560521.936575:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815560960:0@lo:400:kworker.0 00000100:00100000:1.0:1787560521.936604:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560521.936640:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815561088 00000100:00100000:1.0:1787560521.936658:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815561088 00000100:00100000:1.0:1787560521.936709:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787560521.936718:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815561088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560521.936767:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815561088:12345-0@lo:400:kworker.0 Request processed in 51us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560521.936775:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787560521.936909:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815560704:0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.936950:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560521.936989:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815561216:0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.937013:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560521.937146:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815560832:0@lo:400:kworker.0 00000100:00100000:0.0:1787560521.937152:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815560704 00000100:00100000:0.0:1787560521.937156:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815560704 00000100:00100000:0.0:1787560521.937186:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00080000:2.0:1787560521.937191:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560521.937193:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815560704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560521.937230:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815560704:12345-0@lo:400:kworker.0 Request processed in 33us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560521.937236:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787560521.940434:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815560704:0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.940475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560521.940497:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815561344:0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.940540:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560521.940575:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815560960 00000100:00100000:3.0:1787560521.940581:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815560960 00000100:00100000:3.0:1787560521.942092:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815561216 00000100:00100000:3.0:1787560521.942100:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815561216 00000100:00100000:3.0:1787560521.942124:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815560832 00000100:00100000:3.0:1787560521.942125:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815560832 00000100:00100000:3.0:1787560521.942137:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787560521.942145:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815560960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.942205:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815560960:12345-0@lo:400:kworker.0 Request processed in 62us (5602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560521.942210:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787560521.942221:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787560521.942225:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815561216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.942246:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815561216:12345-0@lo:400:kworker.0 Request processed in 21us (5234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560521.942249:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787560521.942255:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787560521.942259:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815560832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.942276:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815560832:12345-0@lo:400:kworker.0 Request processed in 17us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560521.942292:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787560521.942324:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815560832:0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.942346:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815561216:0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.942374:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815561344 00000100:00100000:3.0:1787560521.942376:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815561344 00000100:00100000:3.0:1787560521.942393:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787560521.942398:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815561344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.942431:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815561344:12345-0@lo:400:kworker.0 Request processed in 33us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560521.942437:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1787560521.942461:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d987385180 x1874392815561344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560521.942471:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815561344:0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.942492:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815560960:0@lo:400:kworker.0 00000100:00100000:3.0:1787560521.942502:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787560521.942507:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d998b70e00, transno 4294967300 00000100:00100000:3.0:1787560521.942517:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815561088:0@lo:400:kworker.0 00000100:00080000:1.0:1787560521.943231:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560521.943242:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560522.447243:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815561472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560522.447317:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560522.447553:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815561472 00000100:00100000:2.0:1787560522.447562:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815561472 00000100:00100000:2.0:1787560522.447616:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787560522.447626:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815561472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560522.447691:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560522.447738:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815561472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560522.447745:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1787560522.448313:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a6d80 x1874392815561472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560522.448332:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815561472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787560522.511029:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560523.535621:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560524.559326:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560524.723092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560524.723135:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560524.723169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560524.723200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560524.723232:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788262400 00000100:00100000:1.0:1787560524.723242:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788262400 00000100:00100000:1.0:1787560524.723295:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788262656 00000100:00100000:1.0:1787560524.723298:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788262656 00000100:00100000:1.0:1787560524.723320:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:1.0:1787560524.723330:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788262400:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560524.723399:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788262400:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 70us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560524.723407:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:1.0:1787560524.723423:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00100000:1.0:1787560524.723429:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788262656:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560524.723453:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788262656:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560524.723459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00080000:1.0:1787560524.723476:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560524.723622:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788262272 00000100:00100000:2.0:1787560524.723626:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788262272 00000100:00100000:2.0:1787560524.723660:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 278 00000100:00100000:2.0:1787560524.723667:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788262272:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560524.723692:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788262272:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560524.723698:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 278 00000100:00100000:3.0:1787560524.723869:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788262528 00000100:00100000:3.0:1787560524.723874:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788262528 00000100:00080000:0.0:1787560524.723904:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560524.723909:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:3.0:1787560524.723916:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788262528:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560524.724021:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788262528:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 106us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560524.724028:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:1.0:1787560525.007154:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815561600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560525.007230:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560525.007327:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815561600 00000100:00100000:0.0:1787560525.007336:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815561600 00000100:00100000:0.0:1787560525.007407:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787560525.007417:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815561600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560525.007449:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787560525.007520:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560525.011542:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815561600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4117us (4301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560525.011566:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787560525.018076:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815561600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787560525.583059:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560526.607284:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560527.055012:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815561728:0@lo:400:kworker.0 00000100:00100000:1.0:1787560527.055055:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815562112:0@lo:400:kworker.0 00000100:00100000:2.0:1787560527.055125:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815561856:0@lo:400:kworker.0 00000100:00100000:1.0:1787560527.057884:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560527.057991:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560527.058007:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815561984:0@lo:400:kworker.0 00000100:00100000:1.0:1787560527.058061:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560527.058125:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815561984 00000100:00100000:1.0:1787560527.058135:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815561984 00000100:00100000:1.0:1787560527.058208:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787560527.058218:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815561984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560527.058278:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815561984:12345-0@lo:400:kworker.0 Request processed in 62us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560527.058285:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787560527.058332:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815561984:0@lo:400:kworker.0 00000100:00100000:0.0:1787560527.058772:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815562112 00000100:00100000:0.0:1787560527.058778:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815562112 00000100:00100000:0.0:1787560527.058822:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787560527.058830:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815562112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560527.058912:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815562112:12345-0@lo:400:kworker.0 Request processed in 83us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560527.058937:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787560527.058976:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815562112:0@lo:400:kworker.0 00000100:00100000:3.0:1787560527.059672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787560527.059676:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560527.059683:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560527.059732:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815562240:0@lo:400:kworker.0 00000100:00100000:3.0:1787560527.059780:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560527.059827:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815562240 00000100:00100000:0.0:1787560527.059833:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815562240 00000100:00100000:0.0:1787560527.059905:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787560527.059915:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815562240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560527.059962:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815562240:12345-0@lo:400:kworker.0 Request processed in 48us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560527.059969:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1787560527.060035:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560527.060268:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560527.060338:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815561728 00000100:00100000:3.0:1787560527.060344:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815561728 00000100:00100000:2.0:1787560527.060346:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815562368:0@lo:400:kworker.0 00000100:00100000:3.0:1787560527.060376:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787560527.060376:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560527.060384:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815561728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560527.060399:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815562368 00000100:00100000:2.0:1787560527.060403:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815562368 00000100:00100000:3.0:1787560527.060417:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815561728:12345-0@lo:400:kworker.0 Request processed in 34us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560527.060423:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787560527.060436:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787560527.060442:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815562368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560527.060535:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815562368:12345-0@lo:400:kworker.0 Request processed in 92us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560527.060542:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787560527.060567:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787560527.060591:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d987386a00 x1874392815562368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560527.060607:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815562368:0@lo:400:kworker.0 00000100:00100000:1.0:1787560527.064526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815561856 00000100:00100000:1.0:1787560527.064561:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815561856 00000100:00100000:1.0:1787560527.064638:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787560527.064651:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815561856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560527.064915:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815561856:12345-0@lo:400:kworker.0 Request processed in 266us (4646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560527.064924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787560527.072492:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815562240:0@lo:400:kworker.0 00000100:00100000:2.0:1787560527.072517:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815561728:0@lo:400:kworker.0 00000100:00100000:2.0:1787560527.072602:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815561856:0@lo:400:kworker.0 00000100:00100000:1.0:1787560527.567531:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560527.567601:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815562496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560527.567782:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560527.568210:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815562496 00000100:00100000:2.0:1787560527.568222:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815562496 00000100:00100000:2.0:1787560527.568290:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787560527.568311:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815562496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560527.568360:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560527.568433:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815562496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560527.568440:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787560527.568604:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a6d80 x1874392815562496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560527.568651:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815562496:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560527.634196:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787560528.079814:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560528.655276:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560529.679113:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560529.842735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560529.842810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560529.843065:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788262912 00000100:00100000:0.0:1787560529.843081:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788262912 00000100:00100000:0.0:1787560529.843228:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00100000:0.0:1787560529.843243:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788262912:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560529.843428:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788262912:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 188us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560529.843437:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00080000:1.0:1787560529.843734:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560529.844050:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788262784 00000100:00100000:3.0:1787560529.844059:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788262784 00000100:00100000:3.0:1787560529.844193:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 280 00000100:00100000:3.0:1787560529.844204:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d984c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788262784:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560529.844274:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d984c5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788262784:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 72us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560529.844281:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 280 00000100:00100000:0.0:1787560529.852495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560529.852562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560529.852719:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788263168 00000100:00100000:1.0:1787560529.852734:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788263168 00000100:00100000:1.0:1787560529.852880:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:1.0:1787560529.852894:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788263168:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560529.853005:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788263168:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 114us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560529.853015:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:2.0:1787560529.853426:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788263040 00000100:00100000:2.0:1787560529.853450:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788263040 00000100:00100000:2.0:1787560529.853511:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:2.0:1787560529.853521:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2341:x1874392788263040:12345-192.168.201.56@tcp:9:kworker.0 00000020:00000080:2.0:1787560529.853550:0:6684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673f0f0 00000100:00080000:2.0:1787560529.853561:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560529.853619:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1787560529.853945:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560529.855271:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560529.855280:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560529.855433:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+2:2341:x1874392788263040:12345-192.168.201.56@tcp:9:kworker.0 Request processed in 1904us (2860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560529.855448:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:2.0:1787560530.127414:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560530.127446:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815562624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560530.127616:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560530.127710:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815562624 00000100:00100000:2.0:1787560530.127719:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815562624 00000100:00100000:2.0:1787560530.127790:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787560530.127801:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815562624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560530.127871:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560530.127929:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815562624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560530.127938:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787560530.127964:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560530.128009:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815562624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787560530.704761:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787560531.192556:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:2.0:1787560531.192566:0:6708:0:(genops.c:885:class_export_put()) final put ffff93d9b38e6000/3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:3.0:1787560531.193568:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b38e6000/3e6b7760-d76b-45e8-8d98-861d14ecc789 for lustre-OST0000 00000020:00000080:3.0:1787560531.193647:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9b38e1800 for lustre-OST0000 00010000:00010000:1.0:1787560531.727065:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560532.175614:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815562880:0@lo:400:kworker.0 00000100:00100000:1.0:1787560532.175729:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560532.175822:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815563392:0@lo:400:kworker.0 00000100:00100000:1.0:1787560532.175877:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560532.175913:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787560532.175918:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815562752:0@lo:400:kworker.0 00000100:00100000:1.0:1787560532.175951:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560532.175969:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815563264:0@lo:400:kworker.0 00000100:00100000:1.0:1787560532.175992:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560532.176028:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815562880 00000100:00100000:1.0:1787560532.176037:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815562880 00000100:00100000:1.0:1787560532.176121:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815563264 00000100:00100000:1.0:1787560532.176125:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815563264 00000100:00100000:1.0:1787560532.176161:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787560532.176173:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815562880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560532.176237:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815562880:12345-0@lo:400:kworker.0 Request processed in 67us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560532.176257:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787560532.176278:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787560532.176285:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815563264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560532.176314:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815563264:12345-0@lo:400:kworker.0 Request processed in 30us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560532.176320:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787560532.176371:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815563264:0@lo:400:kworker.0 00000100:00100000:1.0:1787560532.176386:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815562880:0@lo:400:kworker.0 00000100:00100000:2.0:1787560532.177011:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815563008:0@lo:400:kworker.0 00000100:00100000:2.0:1787560532.177059:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560532.177117:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560532.177124:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815563136:0@lo:400:kworker.0 00000100:00100000:2.0:1787560532.177149:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560532.177193:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815563392 00000100:00100000:2.0:1787560532.177200:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815563392 00000100:00100000:2.0:1787560532.177257:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815563136 00000100:00100000:2.0:1787560532.177261:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815563136 00000100:00100000:2.0:1787560532.177287:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787560532.177295:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815563392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560532.177338:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815563392:12345-0@lo:400:kworker.0 Request processed in 43us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560532.177344:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787560532.177357:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787560532.177363:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815563136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560532.177394:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815563136:12345-0@lo:400:kworker.0 Request processed in 31us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560532.177400:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787560532.177421:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815562752 00000100:00100000:2.0:1787560532.177424:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815562752 00000100:00100000:2.0:1787560532.177450:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787560532.177456:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98328b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815562752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560532.177498:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98328b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815562752:12345-0@lo:400:kworker.0 Request processed in 42us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560532.177504:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:2.0:1787560532.177532:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560532.177537:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560532.177541:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560532.177603:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815563136:0@lo:400:kworker.0 00000100:00100000:0.0:1787560532.178034:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815563008 00000100:00100000:0.0:1787560532.178041:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815563008 00000100:00100000:0.0:1787560532.178103:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787560532.178113:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815563008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560532.178172:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815563008:12345-0@lo:400:kworker.0 Request processed in 62us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560532.178178:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787560532.178220:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815563008:0@lo:400:kworker.0 00000100:00100000:1.0:1787560532.178524:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815562752:0@lo:400:kworker.0 00010000:00080000:1.0:1787560532.178543:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a6680 x1874392815563392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560532.178554:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815563392:0@lo:400:kworker.0 00000100:00080000:2.0:1787560532.178736:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560532.689576:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815563520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560532.689678:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560532.689933:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815563520 00000100:00100000:0.0:1787560532.689944:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815563520 00000100:00100000:0.0:1787560532.690018:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787560532.690030:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815563520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560532.690080:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560532.690157:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815563520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560532.690165:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787560532.690761:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9900a5180 x1874392815563520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560532.690797:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815563520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787560532.752093:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560533.775095:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560534.800613:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560534.965044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560534.965101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560534.965137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560534.965234:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788263552 00000100:00100000:2.0:1787560534.965248:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788263552 00000100:00100000:2.0:1787560534.965345:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788263424 00000100:00100000:2.0:1787560534.965349:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788263424 00000100:00100000:2.0:1787560534.965378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:2.0:1787560534.965390:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788263552:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560534.965513:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788263552:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 125us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560534.965522:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:2.0:1787560534.965542:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 125 00000100:00100000:2.0:1787560534.965549:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2343:x1874392788263424:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560534.965588:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2343:x1874392788263424:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 40us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560534.965595:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 125 00000100:00080000:0.0:1787560534.966531:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560534.966540:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788263296 00000100:00100000:3.0:1787560534.966552:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788263296 00000100:00100000:3.0:1787560534.966612:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 282 00000100:00100000:3.0:1787560534.966622:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2343:x1874392788263296:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560534.966671:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2343:x1874392788263296:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 50us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560534.966678:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 282 00000100:00100000:3.0:1787560535.247389:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815563648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560535.247495:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560535.261654:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815563648 00000100:00100000:0.0:1787560535.261676:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815563648 00000100:00080000:2.0:1787560535.261774:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560535.261794:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787560535.261808:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815563648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560535.261905:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560535.262040:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815563648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 234us (14543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560535.262050:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787560535.262131:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815563648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787560535.825191:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560536.847955:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560537.297754:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815564032:0@lo:400:kworker.0 00000100:00100000:1.0:1787560537.297875:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560537.298232:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815563904:0@lo:400:kworker.0 00000100:00100000:0.0:1787560537.298271:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560537.298297:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815564416:0@lo:400:kworker.0 00000100:00100000:0.0:1787560537.298324:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560537.298366:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787560537.298383:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815563776:0@lo:400:kworker.0 00000100:00100000:0.0:1787560537.298419:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560537.298444:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815564288:0@lo:400:kworker.0 00000100:00100000:0.0:1787560537.298469:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560537.298508:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815564032 00000100:00100000:0.0:1787560537.298518:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815564032 00000100:00100000:0.0:1787560537.298587:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815563904 00000100:00100000:0.0:1787560537.298591:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815563904 00000100:00100000:0.0:1787560537.298606:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815564288 00000100:00100000:0.0:1787560537.298608:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815564288 00000100:00100000:0.0:1787560537.298628:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787560537.298640:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815564032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560537.298828:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815564032:12345-0@lo:400:kworker.0 Request processed in 188us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560537.298837:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787560537.298887:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787560537.298894:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815563904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560537.298932:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815563904:12345-0@lo:400:kworker.0 Request processed in 38us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560537.298938:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787560537.298951:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787560537.298958:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815564288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560537.299178:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560537.299192:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815564160:0@lo:400:kworker.0 00000100:00100000:1.0:1787560537.299226:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560537.299290:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815564032:0@lo:400:kworker.0 00000100:00100000:1.0:1787560537.299332:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815564416 00000100:00100000:1.0:1787560537.299337:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815564416 00000100:00100000:1.0:1787560537.299371:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815564160 00000100:00100000:1.0:1787560537.299387:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815564160 00000100:00100000:1.0:1787560537.299413:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787560537.299420:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815564416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560537.299457:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815564416:12345-0@lo:400:kworker.0 Request processed in 38us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560537.299464:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787560537.299477:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787560537.299483:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815564160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560537.299513:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815564160:12345-0@lo:400:kworker.0 Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560537.299518:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787560537.299549:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815564160:0@lo:400:kworker.0 00000100:00100000:1.0:1787560537.299597:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815563776 00000100:00100000:1.0:1787560537.299601:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815563776 00000100:00100000:1.0:1787560537.299626:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787560537.299633:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815563776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560537.299663:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815563776:12345-0@lo:400:kworker.0 Request processed in 30us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560537.299668:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787560537.300294:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815564288:12345-0@lo:400:kworker.0 Request processed in 1335us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560537.300302:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787560537.300333:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560537.300337:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560537.300340:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560537.300368:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815563776:0@lo:400:kworker.0 00000100:00100000:0.0:1787560537.300417:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815564288:0@lo:400:kworker.0 00000100:00100000:0.0:1787560537.300431:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815563904:0@lo:400:kworker.0 00010000:00080000:0.0:1787560537.300444:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bf920380 x1874392815564416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560537.300455:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815564416:0@lo:400:kworker.0 00000100:00100000:2.0:1787560537.809143:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815564544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560537.809230:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560537.809310:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815564544 00000100:00100000:2.0:1787560537.809318:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815564544 00000100:00100000:2.0:1787560537.809543:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560537.809553:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815564544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560537.809588:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560537.809632:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815564544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560537.809640:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787560537.809677:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b3939180 x1874392815564544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560537.809696:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815564544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787560537.874200:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787560538.319716:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787560538.903965:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560539.919107:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560540.088004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560540.088070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560540.088101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560540.088136:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788263808 00000100:00100000:0.0:1787560540.088147:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788263808 00000100:00100000:3.0:1787560540.088162:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788263680 00000100:00100000:3.0:1787560540.088176:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788263680 00000100:00100000:0.0:1787560540.088215:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788263936 00000100:00100000:0.0:1787560540.088221:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788263936 00000100:00100000:0.0:1787560540.088258:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 129 00000100:00100000:3.0:1787560540.088263:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 284 00000100:00100000:3.0:1787560540.088278:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2343:x1874392788263680:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560540.088287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2343:x1874392788263808:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560540.088377:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2343:x1874392788263808:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 110us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560540.088387:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2343:x1874392788263680:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 111us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560540.088396:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 284 00000100:00100000:0.0:1787560540.088414:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 129 00000100:00100000:0.0:1787560540.088446:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:0.0:1787560540.088455:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788263936:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560540.088500:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788263936:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 36us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560540.088507:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00080000:0.0:1787560540.088528:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560540.373126:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815564672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560540.373220:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560540.373926:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815564672 00000100:00100000:2.0:1787560540.373936:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815564672 00000100:00100000:2.0:1787560540.374013:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560540.374024:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815564672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560540.374059:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560540.374116:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815564672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560540.374124:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560540.374172:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815564672:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787560540.374936:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787560540.707614:0:11845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 04:35:39 (1787560539) 00010000:00010000:3.0:1787560540.944536:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560541.972563:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560542.261452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560542.261602:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788264064 00000100:00100000:0.0:1787560542.261614:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788264064 00000100:00100000:0.0:1787560542.261695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00100000:0.0:1787560542.261708:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:10215:x1874392788264064:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560542.261732:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560542.261809:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f1bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922e7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.261902:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f1c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.261916:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.261929:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560542.262131:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787560542.262135:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560542.262216:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f1c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.262240:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f1bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922e7 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.262255:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f1c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922e7 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.262264:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3a00) 00010000:00010000:0.0:1787560542.262266:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560542.262312:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980031800, rc 0) 00000100:00100000:0.0:1787560542.262374:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:10215:x1874392788264064:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 670us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560542.262382:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00080000:2.0:1787560542.262498:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560542.272691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560542.272800:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788264192 00000100:00100000:2.0:1787560542.272810:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788264192 00000100:00100000:2.0:1787560542.272905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:2.0:1787560542.272917:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:10216:x1874392788264192:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560542.272938:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560542.272957:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f1c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273036:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f1d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273050:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f1d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273060:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f1d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273075:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f1d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273082:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273088:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273515:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710a00/0xe34191b05673f1de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273524:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710a00/0xe34191b05673f1de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273532:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710a00/0xe34191b05673f1de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560542.273608:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787560542.273612:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560542.273685:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710a00/0xe34191b05673f1de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273707:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f1d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273713:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f1d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273719:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f1d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273725:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560542.273729:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f1d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273735:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f1d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273746:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3a00) 00010000:00010000:2.0:1787560542.273750:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560542.273754:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f1d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273760:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f1d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273776:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273782:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f1d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273787:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273798:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560542.273801:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273806:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f1d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273814:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93d987d52800) 00010000:00010000:2.0:1787560542.273816:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560542.273819:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f1d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273826:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f1d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273905:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f1c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922ee expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273920:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710a00/0xe34191b05673f1de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922ee expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560542.273928:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d987d52100) 00010000:00010000:2.0:1787560542.273930:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560542.273932:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710a00, rc 0) 00000100:00100000:2.0:1787560542.274007:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:10216:x1874392788264192:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 1092us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560542.274015:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:3.0:1787560542.279460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560542.285268:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788264448 00000100:00100000:0.0:1787560542.285284:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788264448 00000100:00100000:0.0:1787560542.286387:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:0.0:1787560542.286405:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:10216:x1874392788264448:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560542.286426:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560542.286450:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f1e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.286533:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f1ec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.286563:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f1ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.286576:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f1ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.286636:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f1f3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.286643:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.286649:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287231:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b05673f1fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287243:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b05673f1fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287251:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b05673f1fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560542.287262:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787560542.287478:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f1ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287487:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f1ec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287495:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f1ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287507:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560542.287512:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f1ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287519:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f1ec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287532:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d987d52100) 00010000:00010000:0.0:1787560542.287535:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560542.287539:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f1ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287545:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f1ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287557:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287563:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f1f3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287568:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287574:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560542.287577:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287583:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f1f3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287602:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93d987fb3300) 00010000:00010000:0.0:1787560542.287605:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560542.287608:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f1f3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.287614:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f1f3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.292644:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f1e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922f5 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.292674:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b05673f1fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922f5 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560542.292684:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:0.0:1787560542.292687:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560542.292690:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2044e00, rc 0) 00000100:00100000:0.0:1787560542.293561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:10216:x1874392788264448:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 7157us (14104us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787560542.293572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:3.0:1787560542.305654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560542.311639:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788264576 00000100:00100000:2.0:1787560542.311675:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788264576 00000100:00100000:3.0:1787560542.316437:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:3.0:1787560542.316453:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:10216:x1874392788264576:12345-192.168.201.56@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787560542.316667:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:10216:x1874392788264576:12345-192.168.201.56@tcp:59:lhsmtool_posix.0 Request processed in 216us (11022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560542.316675:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:0.0:1787560542.415594:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815565056:0@lo:400:kworker.0 00000100:00100000:0.0:1787560542.415670:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560542.415751:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560542.415758:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815565184:0@lo:400:kworker.0 00000100:00100000:0.0:1787560542.415784:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787560542.416623:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787560542.417249:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815564800:0@lo:400:kworker.0 00000100:00100000:3.0:1787560542.417313:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560542.417352:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815565312:0@lo:400:kworker.0 00000100:00100000:3.0:1787560542.417388:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560542.417418:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787560542.417425:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815564928:0@lo:400:kworker.0 00000100:00100000:3.0:1787560542.417464:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560542.417485:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815565440:0@lo:400:kworker.0 00000100:00100000:3.0:1787560542.417508:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560542.417547:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815565184 00000100:00100000:3.0:1787560542.417554:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815565184 00000100:00100000:3.0:1787560542.417607:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815565440 00000100:00100000:3.0:1787560542.417611:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815565440 00000100:00100000:3.0:1787560542.417634:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787560542.417643:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815565184:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787560542.417884:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560542.417889:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560542.417899:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815565056 00000100:00100000:2.0:1787560542.417903:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815565056 00000100:00100000:2.0:1787560542.417935:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815565312 00000100:00100000:2.0:1787560542.417937:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815565312 00000100:00100000:2.0:1787560542.417949:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815564928 00000100:00100000:2.0:1787560542.417952:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815564928 00000100:00100000:2.0:1787560542.417963:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787560542.417970:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815565056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560542.418224:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815565184:12345-0@lo:400:kworker.0 Request processed in 580us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560542.418232:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787560542.418250:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787560542.418257:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815565440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560542.418316:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815565440:12345-0@lo:400:kworker.0 Request processed in 60us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560542.418323:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787560542.418353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787560542.418360:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815565312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560542.418478:0:6706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787560542.418493:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787560542.418608:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787560542.418616:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815564928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560542.418652:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815564928:12345-0@lo:400:kworker.0 Request processed in 37us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560542.418658:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787560542.418838:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815564928:0@lo:400:kworker.0 00010000:00080000:1.0:1787560542.418880:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d99012f480 x1874392815565440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560542.418891:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815565440:0@lo:400:kworker.0 00000100:00100000:1.0:1787560542.418926:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815565184:0@lo:400:kworker.0 00000100:00080000:1.0:1787560542.418954:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560542.419342:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815565312:12345-0@lo:400:kworker.0 Request processed in 981us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560542.419350:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787560542.419648:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815565056:12345-0@lo:400:kworker.0 Request processed in 1676us (3976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560542.419656:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787560542.419818:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815564800 00000100:00100000:0.0:1787560542.419825:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815564800 00000100:00100000:0.0:1787560542.419903:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787560542.419911:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815564800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560542.419953:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815564800:12345-0@lo:400:kworker.0 Request processed in 43us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560542.419959:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787560542.420366:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815565056:0@lo:400:kworker.0 00000100:00100000:1.0:1787560542.420481:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815564800:0@lo:400:kworker.0 00000100:00100000:1.0:1787560542.420495:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815565312:0@lo:400:kworker.0 00000100:00100000:1.0:1787560542.927156:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815565568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560542.927257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560542.932681:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815565568 00000100:00100000:2.0:1787560542.932702:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815565568 00000100:00100000:2.0:1787560542.932777:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560542.932789:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815565568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560542.932843:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560542.933252:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815565568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 464us (5994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560542.933263:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787560542.938110:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9b3939180 x1874392815565568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560542.938146:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815565568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560542.993812:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560544.015147:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560544.637999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560544.638128:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788264704 00000100:00100000:0.0:1787560544.638138:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788264704 00000100:00100000:0.0:1787560544.638214:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:0.0:1787560544.638226:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:10258:x1874392788264704:12345-192.168.201.56@tcp:101:lfs.0 00000100:00080000:1.0:1787560544.638334:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787560544.638493:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560544.638529:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf922fc expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.638595:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f20f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.638620:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f20f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.638633:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f20f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.638648:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f216 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.638654:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.638661:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639296:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f20f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639315:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f20f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639321:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f20f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639327:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2045e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560544.639331:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f20f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639338:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f20f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639351:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3a00) 00010000:00010000:1.0:1787560544.639354:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560544.639358:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f20f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639365:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f20f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639378:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639384:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f216 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639390:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f216 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639395:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560544.639404:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f216 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639410:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f216 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639419:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93d987fb3900) 00010000:00010000:1.0:1787560544.639421:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560544.639424:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f216 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639429:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f216 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639465:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f208 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922fc expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639475:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3a00) 00010000:00010000:1.0:1787560544.639477:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560544.639480:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f208 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922fc expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.639489:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2044c00, rc 0) 00000100:00100000:1.0:1787560544.639565:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:10258:x1874392788264704:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1340us (1573us total) trans 0 rc 301/301 00000100:00100000:1.0:1787560544.639573:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:3.0:1787560544.644825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560544.645026:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788264960 00000100:00100000:1.0:1787560544.645036:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788264960 00000100:00100000:1.0:1787560544.645123:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:1.0:1787560544.645134:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:10258:x1874392788264960:12345-192.168.201.56@tcp:36:lfs.0 00010000:00010000:1.0:1787560544.645199:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560544.645224:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980031800/0xe34191b05673f1c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922e7 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.645242:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987fb3a00) 00010000:00010000:1.0:1787560544.645271:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560544.645545:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f21d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.645561:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f21d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.645569:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f21d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.645582:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.645589:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.645595:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560544.646567:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787560544.646579:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f21d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.646588:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f21d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.646595:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f21d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.646607:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560544.646613:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f21d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.646620:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f21d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.646632:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27600) 00010000:00010000:1.0:1787560544.646635:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560544.646638:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f21d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.646644:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f21d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560544.646660:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c1180a1 reply state 0000000055f0003d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560544.646669:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560544.646792:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:10258:x1874392788264960:12345-192.168.201.56@tcp:36:lfs.0 Request processed in 1657us (1975us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787560544.646800:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 37 00010000:00010000:3.0:1787560544.654190:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560544.654209:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560544.654218:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560544.654224:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560544.654229:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560544.654236:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560544.654269:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93d995c27800) 00010000:00010000:3.0:1787560544.654273:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560544.654278:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560544.654299:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f224 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560544.756268:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560544.756334:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788265088 00000100:00100000:2.0:1787560544.756345:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788265088 00000100:00100000:2.0:1787560544.756406:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:2.0:1787560544.756414:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:10266:x1874392788265088:12345-192.168.201.56@tcp:101:lctl.0 00010000:00010000:2.0:1787560544.756450:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560544.756476:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673f22b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92303 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560544.756543:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f232 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560544.756556:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560544.756565:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560544.756614:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787560544.756616:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560544.756646:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f232 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560544.756664:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673f22b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92303 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560544.756690:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f232 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92303 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560544.756696:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:2.0:1787560544.756698:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560544.756701:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710000, rc 0) 00000100:00100000:2.0:1787560544.756750:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:10266:x1874392788265088:12345-192.168.201.56@tcp:101:lctl.0 Request processed in 336us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560544.756771:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:3.0:1787560544.809092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560544.809197:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788265216 00000100:00100000:1.0:1787560544.809211:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788265216 00000100:00100000:1.0:1787560544.809304:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:1.0:1787560544.809316:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:10272:x1874392788265216:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1787560544.809338:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560544.809356:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9230a expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809426:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f240 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809437:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809446:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809454:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f247 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809458:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809463:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809678:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f24e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809684:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f24e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809689:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f24e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560544.809711:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787560544.809713:0:6706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560544.809743:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f24e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809990:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809994:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f240 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.809998:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810002:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560544.810005:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810009:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f240 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810018:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:1.0:1787560544.810020:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560544.810023:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f240 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810027:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810035:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810038:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f247 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810041:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810048:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560544.810050:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810053:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f247 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810057:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff93d995c27600) 00010000:00010000:1.0:1787560544.810059:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560544.810060:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f247 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810063:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f247 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810087:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9230a expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810095:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f24e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9230a expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.810099:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:1.0:1787560544.810100:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787560544.810101:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260a00, rc 0) 00000100:00100000:2.0:1787560544.813415:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:10272:x1874392788265216:12345-192.168.201.56@tcp:101:bash.0 Request processed in 4090us (4328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560544.813428:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:3.0:1787560544.817153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560544.817358:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788265472 00000100:00100000:1.0:1787560544.817368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788265472 00000100:00100000:1.0:1787560544.817437:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 40 00000100:00100000:1.0:1787560544.817447:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:10272:x1874392788265472:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1787560544.817484:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560544.817506:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f255 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92311 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.818080:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f25c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.818095:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f25c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.818107:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f25c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.818171:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.818179:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.818186:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787560544.819135:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787560544.819612:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.819626:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.819636:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.819687:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f25c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.819693:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f25c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.819700:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f25c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.819706:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560544.819711:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f25c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.819718:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f25c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.819730:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:1.0:1787560544.819733:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560544.819737:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f25c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.819743:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f25c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560544.820035:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdbcc79d reply state 00000000d9096581 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560544.820044:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787560544.820083:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f255 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92311 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.820111:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92311 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.820120:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d995c27000) 00010000:00010000:1.0:1787560544.820123:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560544.820125:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261200, rc 0) 00000100:00100000:1.0:1787560544.820340:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:10272:x1874392788265472:12345-192.168.201.56@tcp:101:bash.0 Request processed in 2893us (3197us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787560544.820351:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 40 00010000:00010000:0.0:1787560544.824003:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.824020:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.824027:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.824033:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560544.824038:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.824045:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.824061:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d995c27600) 00010000:00010000:0.0:1787560544.824065:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560544.824068:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.824074:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f263 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560544.828654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560544.830735:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788265600 00000100:00100000:1.0:1787560544.830749:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788265600 00000100:00100000:1.0:1787560544.831007:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:1.0:1787560544.831016:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1874392788265600:12345-192.168.201.56@tcp:8:bash.0 00010000:00080000:1.0:1787560544.831047:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:1.0:1787560544.831079:0:6683:0:(genops.c:1385:class_connect()) connect: client 3e6b7760-d76b-45e8-8d98-861d14ecc789, cookie 0xe34191b05673f278 00002000:00100000:1.0:1787560544.831091:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3e6b7760-d76b-45e8-8d98-861d14ecc789/ffff93d9b4027000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787560544.831114:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787560544.831359:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787560544.831394:0:6683:0:(import.c:65:import_set_state_nolock()) ffff93d9b4025800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560544.831470:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2341:x1874392788265600:12345-192.168.201.56@tcp:8:bash.0 Request processed in 453us (2825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560544.831479:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:3.0:1787560544.837140:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560544.837329:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788265728 00000100:00100000:0.0:1787560544.837340:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788265728 00000100:00080000:1.0:1787560544.837463:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560544.837521:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:0.0:1787560544.837533:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:0:x1874392788265728:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560544.837558:0:8101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560544.837593:0:8101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec0200c6/0xe34191b05673f27f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92318 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560544.837622:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560544.837640:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1787560544.837645:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560544.837654:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0200c6/0xe34191b05673f27f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92318 expref: 7 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.837676:0:8101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec0200c6/0xe34191b05673f27f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92318 expref: 7 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.837692:0:8101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2044600, rc 0) 00000100:00100000:0.0:1787560544.837755:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:0:x1874392788265728:12345-192.168.201.56@tcp:101:bash.0 Request processed in 224us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560544.837773:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:3.0:1787560544.840989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560544.841419:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788265856 00000100:00100000:2.0:1787560544.841429:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788265856 00000100:00100000:0.0:1787560544.841476:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:0.0:1787560544.841488:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:10272:x1874392788265856:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560544.841506:0:8101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560544.841524:0:8101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9231f expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.841555:0:8101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec0200c6/0xe34191b05673f27f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92318 expref: 8 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.841565:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560544.841584:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560544.841590:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 8 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.841626:0:8101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec0200c6/0xe34191b05673f27f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92318 expref: 8 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.841640:0:8101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec0200c6/0xe34191b05673f27f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92318 expref: 8 pid: 8101 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560544.841654:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8101:1874392815565696:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560544.841745:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38fae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560544.844801:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560544.844874:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788265984 00000100:00100000:1.0:1787560544.844895:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788265984 00010000:00010000:1.0:1787560544.844933:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec0200c6/0xe34191b05673f27f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92318 expref: 9 pid: 8101 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560544.844983:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:1.0:1787560544.844994:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2342:x1874392788265984:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560544.845008:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560544.845031:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec0200c6/0xe34191b05673f27f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92318 expref: 9 pid: 8101 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.845044:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec0200c6/0xe34191b05673f27f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92318 expref: 9 pid: 8101 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.845069:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560544.845074:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560544.845082:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 9 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.845092:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 9 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.845131:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 9 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560544.845144:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf920e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1874392815565824:192.168.201.56@tcp:105: 00000100:00100000:1.0:1787560544.845224:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9902fae40 going to sleep for 11 seconds 00010000:00010000:0.0:1787560544.845227:0:8101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec0200c6/0xe34191b05673f27f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92318 expref: 9 pid: 8101 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560544.845259:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8101:1874392815565696:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560544.845286:0:8101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 8 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560544.845297:0:8101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2045e00, rc 0) 00000100:00100000:0.0:1787560544.845324:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:10272:x1874392788265856:12345-192.168.201.56@tcp:101:bash.0 Request processed in 3840us (4344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560544.845332:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:1.0:1787560544.849659:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf920e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1874392815565824:192.168.201.56@tcp:105: 00010000:00010000:1.0:1787560544.849688:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560544.849749:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788265984:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 4756us (4956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560544.849760:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:3.0:1787560544.853683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560544.853786:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788266240 00000100:00100000:1.0:1787560544.853796:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788266240 00000100:00100000:1.0:1787560544.854060:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:1.0:1787560544.854071:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:10272:x1874392788266240:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:1.0:1787560544.856108:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:10272:x1874392788266240:12345-192.168.201.56@tcp:35:bash.0 Request processed in 2031us (2425us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787560544.856119:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:3.0:1787560544.963656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560544.963776:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788266496 00000100:00100000:1.0:1787560544.963786:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788266496 00000100:00100000:1.0:1787560544.963890:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00100000:1.0:1787560544.963900:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:10282:x1874392788266496:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560544.963925:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560544.963945:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f28d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92326 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560544.964056:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787560544.964179:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f28d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92326 expref: 16 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.964194:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:1.0:1787560544.964196:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560544.964220:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f28d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92326 expref: 16 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560544.964234:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261800, rc 0) 00000100:00100000:1.0:1787560544.964304:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:10282:x1874392788266496:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 405us (658us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787560544.964311:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00100000:3.0:1787560544.968293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560544.968381:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788266752 00000100:00100000:0.0:1787560544.968389:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788266752 00000100:00100000:0.0:1787560544.968433:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:0.0:1787560544.968453:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:10282:x1874392788266752:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560544.968686:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:10282:x1874392788266752:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 232us (403us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787560544.968693:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00010000:00010000:0.0:1787560545.039526:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560545.054658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560545.054807:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788266880 00000100:00100000:2.0:1787560545.054816:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788266880 00000100:00100000:2.0:1787560545.054936:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:2.0:1787560545.054948:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:10288:x1874392788266880:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560545.054971:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560545.054990:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673f29b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9232d expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.055054:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f2a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.055065:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.055073:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560545.055121:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787560545.055124:0:6706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560545.055140:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.055162:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673f29b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9232d expref: 18 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.055185:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9232d expref: 17 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.055207:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:2.0:1787560545.055211:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560545.055214:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710600, rc 0) 00000100:00100000:2.0:1787560545.055297:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:10288:x1874392788266880:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 351us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560545.055304:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:3.0:1787560545.060934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.061024:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788267136 00000100:00100000:1.0:1787560545.061035:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788267136 00000100:00100000:1.0:1787560545.061101:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:1.0:1787560545.061112:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:10288:x1874392788267136:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560545.061133:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560545.061155:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f2a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92334 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.061272:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f2b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.061286:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.061296:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560545.061307:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787560545.061450:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f2a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92334 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.061468:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92334 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.061489:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d995c27000) 00010000:00010000:1.0:1787560545.061492:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560545.061496:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261e00, rc 0) 00000100:00100000:1.0:1787560545.061829:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10288:x1874392788267136:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 717us (904us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787560545.061924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:3.0:1787560545.066727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560545.066773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.066829:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788267520 00000100:00100000:0.0:1787560545.066887:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788267264 00000100:00100000:0.0:1787560545.066897:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788267264 00000100:00100000:1.0:1787560545.066959:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788267520 00000100:00100000:0.0:1787560545.066966:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:0.0:1787560545.066980:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:2342:x1874392788267264:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560545.066995:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560545.067019:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f2b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92334 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.067038:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d995c27000) 00010000:00010000:0.0:1787560545.067042:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560545.067119:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:2342:x1874392788267264:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 142us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560545.067124:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:1.0:1787560545.067133:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10288:x1874392788267520:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560545.067152:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560545.067167:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f2be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9233b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560545.067224:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 2 00010000:00010000:1.0:1787560545.067275:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f2c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.067288:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f2c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.067299:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f2c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560545.067310:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787560545.067444:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f2be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9233b expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.067477:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f2c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9233b expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.067485:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d995c27000) 00010000:00010000:1.0:1787560545.067488:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787560545.067490:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260800, rc 0) 00000100:00100000:1.0:1787560545.067510:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:10288:x1874392788267520:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 379us (737us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787560545.067514:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:0.0:1787560545.072903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560545.073039:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788267648 00000100:00100000:3.0:1787560545.073048:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788267648 00000100:00100000:3.0:1787560545.073092:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:3.0:1787560545.073100:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788267648:12345-192.168.201.56@tcp:1:lfs.0 00010000:00010000:3.0:1787560545.073134:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.073149:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 7 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.073163:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560545.073178:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560545.073181:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.073210:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 7 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.073219:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 7 pid: 8101 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560545.073230:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874392815565952:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560545.073313:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9851209c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560545.080840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560545.082111:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874392815565952:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560545.082139:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560545.085594:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788267776 00000100:00100000:0.0:1787560545.085621:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788267776 00002000:00100000:0.0:1787560545.085681:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff93d9b393bb80 x1874392788267776/t0(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:661/0 lens 504/0 e 0 to 0 dl 1787560556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787560545.085693:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9b393bb80 with x1874392788267776 ext(0->12) 00010000:00010000:0.0:1787560545.085702:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 8 pid: 8101 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.085732:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 8 pid: 8101 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560545.085741:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93d9b393bb80 00000100:00100000:0.0:1787560545.085783:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:0.0:1787560545.085793:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788267776:12345-192.168.201.56@tcp:4:lfs.0 00000001:00100000:0.0:1787560545.148874:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000100:00100000:2.0:1787560545.151981:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2343:x1874392788267776:12345-192.168.201.56@tcp:4:lfs.0 Request processed in 66181us (71143us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787560545.152001:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00002000:00100000:2.0:1787560545.152013:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff93d9b393bb80 x1874392788267776/t4294967299(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:661/0 lens 504/448 e 0 to 0 dl 1787560556 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560545.152023:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9b393bb80 with x1874392788267776 ext(0->12) 00010000:00010000:2.0:1787560545.152035:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 9 pid: 8101 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.152053:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 9 pid: 8101 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560545.152061:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93d9b393bb80 00000100:00100000:0.0:1787560545.155348:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560545.155703:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788267904 00000100:00100000:2.0:1787560545.155715:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788267904 00010000:00010000:2.0:1787560545.155758:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 9 pid: 8101 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560545.156037:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:3.0:1787560545.156050:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2343:x1874392788267904:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560545.156067:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787560545.156087:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787560545.156090:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787560545 00002000:00010000:3.0:1787560545.156092:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787560545 00002000:00010000:3.0:1787560545.156094:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787560545 00010000:00010000:3.0:1787560545.156100:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 9 pid: 8101 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.156128:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 9 pid: 8101 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.156151:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05673f286 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9231f expref: 9 pid: 8101 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.156169:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560545.156173:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560545.156179:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.156189:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.156228:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560545.156304:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788267904:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 257us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560545.156311:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 36 00010000:00010000:0.0:1787560545.156379:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.156389:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.156412:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.156420:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.156428:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.156434:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c4400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560545.156446:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.156455:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.156468:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.156476:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a2e316b/0xe34191b05673f2d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560545.156533:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788267648:12345-192.168.201.56@tcp:1:lfs.0 Request processed in 83433us (83644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560545.156541:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:0.0:1787560545.160804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.161076:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788268160 00000100:00100000:1.0:1787560545.161085:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788268160 00000100:00100000:1.0:1787560545.161146:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:1.0:1787560545.161157:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:10288:x1874392788268160:12345-192.168.201.56@tcp:35:lfs.0 00000004:00010000:1.0:1787560545.161221:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f2c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9233b expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560545.161571:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787560545.161990:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787560545.169515:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787560545.169612:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.169632:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92311 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.169640:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.169677:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92311 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.169720:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92311 expref: 24 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560545.169736:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1874392815566080:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560545.169835:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9812edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560545.174339:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1874392815566080:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560545.174372:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560545.174646:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560545.175055:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788268288 00000100:00100000:2.0:1787560545.175064:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788268288 00010000:00010000:2.0:1787560545.175101:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92311 expref: 25 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560545.175147:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:2.0:1787560545.175157:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:2343:x1874392788268288:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560545.175171:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560545.175187:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92311 expref: 25 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.175199:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92311 expref: 25 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.175219:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f26a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92311 expref: 25 pid: 5839 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.175567:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d995c27000) 00010000:00010000:2.0:1787560545.175573:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.175581:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.175587:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.175623:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560545.175654:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560545.175661:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560545.175676:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:2343:x1874392788268288:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 520us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560545.175684:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 37 00000001:00080000:0.0:1787560545.175797:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787560545.176121:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787560545.176276:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815566208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787560545.176347:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560545.176381:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d990476d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560545.176650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815566208 00000100:00100000:3.0:1787560545.176657:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815566208 00000100:00100000:3.0:1787560545.176713:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560545.176723:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874392815566208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787560545.176805:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874392815566208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560545.176812:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560545.176909:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815566208:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1787560545.177214:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787560545.177834:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787560545.178740:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3938000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815566336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787560545.178802:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560545.178843:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98b58af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560545.178996:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815566336 00000100:00100000:3.0:1787560545.179003:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815566336 00000100:00100000:3.0:1787560545.179065:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560545.179085:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874392815566336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787560545.179425:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1874392815566336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 351us (622us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787560545.179433:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560545.179514:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3938000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815566336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787560545.179572:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787560545.179615:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.179627:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.179636:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.179643:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560545.179648:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.179656:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.179672:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d995c27000) 00010000:00010000:2.0:1787560545.179687:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787560545.179692:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.179699:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f2da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560545.179906:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787560545.180115:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787560545.180126:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373933278476ns, next at 374933276404ns, rc = 0 00000001:00080000:2.0:1787560545.180133:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787560545.180166:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d995c27000) 00010000:00010000:2.0:1787560545.180169:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787560545.180472:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f2c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9233b expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560545.180587:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10288:x1874392788268160:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 19431us (19793us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787560545.180597:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000020:00080000:2.0:1787560545.180603:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787560545.185009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560545.185108:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788268416 00000100:00100000:2.0:1787560545.185119:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788268416 00000100:00100000:2.0:1787560545.185608:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:2.0:1787560545.185619:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10288:x1874392788268416:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560545.185646:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560545.185668:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f2e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92342 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.185727:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f2e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92342 expref: 28 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.185749:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f2e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92342 expref: 28 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.185762:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:2.0:1787560545.185764:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560545.185767:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711600, rc 0) 00000100:00100000:2.0:1787560545.185817:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+28:10288:x1874392788268416:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 201us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560545.185822:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:2.0:1787560545.190940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.190996:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788268672 00000100:00100000:1.0:1787560545.191006:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788268672 00000100:00100000:1.0:1787560545.191064:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:1.0:1787560545.191076:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae745050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+28:10288:x1874392788268672:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:1.0:1787560545.191571:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae745050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:10288:x1874392788268672:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 495us (639us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787560545.191596:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:3.0:1787560545.204424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560545.204472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.204491:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788268928 00000100:00100000:1.0:1787560545.204502:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788268928 00000100:00100000:0.0:1787560545.204528:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788268800 00000100:00100000:0.0:1787560545.204532:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788268800 00000100:00100000:0.0:1787560545.204560:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 286 00000100:00100000:0.0:1787560545.204570:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d983289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788268800:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560545.204616:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 134 00000100:00100000:1.0:1787560545.204624:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788268928:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:2.0:1787560545.204680:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560545.204968:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d983289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788268800:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 398us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560545.204977:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 286 00000100:00100000:1.0:1787560545.205005:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788268928:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 380us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560545.205012:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 134 00000100:00100000:0.0:1787560545.370574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.370787:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788269184 00000100:00100000:1.0:1787560545.370797:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788269184 00000100:00100000:1.0:1787560545.370889:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:1.0:1787560545.370900:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:10298:x1874392788269184:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560545.370928:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560545.370948:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f2e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92349 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560545.371055:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787560545.371155:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f2e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92349 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.371168:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:1.0:1787560545.371171:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560545.371176:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f2e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92349 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.371190:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261800, rc 0) 00000100:00100000:1.0:1787560545.376337:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:10298:x1874392788269184:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 5424us (5757us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787560545.376350:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:0.0:1787560545.381304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560545.381545:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788269312 00000100:00100000:2.0:1787560545.381556:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788269312 00000100:00100000:2.0:1787560545.381614:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:2.0:1787560545.381624:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:10298:x1874392788269312:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:2.0:1787560545.381723:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f2f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381740:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381754:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381768:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f2fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381776:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381797:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381919:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381928:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381935:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560545.381973:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381985:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f2f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381990:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f2f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.381997:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f2f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382003:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560545.382006:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f2f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382014:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f2f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382024:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:2.0:1787560545.382034:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560545.382038:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f2f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382045:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f2f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382058:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382064:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f2fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382070:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f2fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382075:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560545.382078:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f2fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382084:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f2fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382092:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d987d52d00) 00010000:00010000:2.0:1787560545.382096:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560545.382098:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f2fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382104:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f2fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382119:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382131:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382137:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382143:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560545.382146:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382152:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382160:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:2.0:1787560545.382162:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560545.382165:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.382169:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560545.382665:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:10298:x1874392788269312:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 1037us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560545.382675:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:0.0:1787560545.389008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560545.389290:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788269568 00000100:00100000:2.0:1787560545.389301:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788269568 00000100:00100000:2.0:1787560545.389357:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:2.0:1787560545.389368:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:10298:x1874392788269568:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:2.0:1787560545.389626:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:10298:x1874392788269568:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 258us (638us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787560545.389646:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:2.0:1787560545.473607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.473707:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788269824 00000100:00100000:1.0:1787560545.473717:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788269824 00000100:00100000:1.0:1787560545.473780:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:1.0:1787560545.473790:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:10301:x1874392788269824:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560545.473816:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560545.473836:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f30b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92350 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.473977:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f312 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.473990:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474001:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474015:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474023:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474029:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474151:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474167:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474174:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560545.474184:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787560545.474296:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474304:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f312 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474311:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474316:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560545.474322:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474328:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f312 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474340:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:1.0:1787560545.474343:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560545.474347:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f312 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474354:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474366:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474379:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f319 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474384:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474388:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560545.474392:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474397:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474405:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d995c27e00) 00010000:00010000:1.0:1787560545.474408:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560545.474410:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f319 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474415:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474455:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f30b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92350 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474467:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92350 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.474473:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560545.474475:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560545.474483:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260200, rc 0) 00000100:00100000:1.0:1787560545.474539:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+33:10301:x1874392788269824:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 750us (942us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787560545.474548:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:0.0:1787560545.478227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.478749:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788269952 00000100:00100000:1.0:1787560545.478758:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788269952 00000100:00100000:1.0:1787560545.478806:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:1.0:1787560545.478816:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+33:10301:x1874392788269952:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:1.0:1787560545.478896:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f32e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.478909:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.478917:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.478937:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.478942:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f32e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.478946:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f32e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.478949:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560545.478953:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f32e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.478957:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f32e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.478979:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560545.478981:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560545.478985:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f32e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.478988:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f32e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560545.479062:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+33:10301:x1874392788269952:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 247us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560545.479069:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:3.0:1787560545.481754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560545.481956:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788270208 00000100:00100000:2.0:1787560545.481965:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788270208 00000100:00100000:2.0:1787560545.482036:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:2.0:1787560545.482046:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+33:10301:x1874392788270208:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:2.0:1787560545.482285:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:10301:x1874392788270208:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 239us (536us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787560545.482292:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:1.0:1787560545.488173:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815566464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560545.488318:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560545.488633:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815566464 00000100:00100000:3.0:1787560545.488641:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815566464 00000100:00100000:3.0:1787560545.488745:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787560545.488755:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815566464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560545.488789:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787560545.488912:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560545.488966:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815566464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 212us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560545.488974:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787560545.489052:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815566464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560545.844788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.844884:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788270464 00000100:00100000:1.0:1787560545.844896:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788270464 00000100:00100000:1.0:1787560545.844959:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:1.0:1787560545.844970:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:10332:x1874392788270464:12345-192.168.201.56@tcp:101:cat.0 00010000:00010000:1.0:1787560545.844995:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560545.845015:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f335 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92357 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.845209:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f33c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.845234:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.845264:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560545.845277:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787560545.845578:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f335 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92357 expref: 37 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.845598:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f33c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92357 expref: 36 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.845607:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560545.845610:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560545.845614:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261800, rc 0) 00000100:00100000:1.0:1787560545.845680:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+36:10332:x1874392788270464:12345-192.168.201.56@tcp:101:cat.0 Request processed in 712us (902us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787560545.845688:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:0.0:1787560545.849702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560545.849751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560545.849835:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788270848 00000100:00100000:2.0:1787560545.849874:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788270848 00000100:00100000:2.0:1787560545.849926:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:2.0:1787560545.849936:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+36:10332:x1874392788270848:12345-192.168.201.56@tcp:35:cat.0 00000100:00100000:2.0:1787560545.850195:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:10332:x1874392788270848:12345-192.168.201.56@tcp:35:cat.0 Request processed in 260us (442us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787560545.850203:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:1.0:1787560545.850692:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788270592 00000100:00100000:1.0:1787560545.850699:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788270592 00000100:00100000:1.0:1787560545.850747:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:1.0:1787560545.850756:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e11850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:2342:x1874392788270592:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560545.850768:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560545.850791:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f33c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92357 expref: 37 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.850808:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560545.850813:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560545.850871:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e11850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+36:2342:x1874392788270592:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 116us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560545.850878:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:0.0:1787560545.940603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560545.940748:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788271104 00000100:00100000:2.0:1787560545.940758:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788271104 00000100:00100000:2.0:1787560545.940819:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:2.0:1787560545.940830:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+36:10338:x1874392788271104:12345-192.168.201.56@tcp:101:dd.0 00010000:00010000:2.0:1787560545.940881:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560545.940884:0:11858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787560545.940910:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f2a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9232d expref: 36 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.940947:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:2.0:1787560545.940953:0:11858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560545.940967:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f34a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9235e expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.941079:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.941092:0:11858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92350 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.941101:0:11858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.941132:0:11858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92350 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560545.941145:0:11858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92350 expref: 36 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560545.941159:0:11858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3939c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815566592:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560545.941275:0:11858:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b4125240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560545.952266:0:11858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3939c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815566592:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560545.952297:0:11858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560545.952461:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.956737:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788271232 00000100:00100000:1.0:1787560545.956752:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788271232 00010000:00010000:1.0:1787560545.956810:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92350 expref: 37 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560545.956943:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:1.0:1787560545.956954:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:2342:x1874392788271232:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560545.956969:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560545.956977:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92350 expref: 37 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.956991:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92350 expref: 37 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.957013:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92350 expref: 37 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.957040:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560545.957047:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.957056:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.957063:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.957119:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560545.957183:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+36:2342:x1874392788271232:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 231us (4723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560545.957191:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00010000:00010000:3.0:1787560545.957265:0:11858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.957274:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560545.957293:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787560545.957489:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f34a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9235e expref: 37 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.957507:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9235e expref: 36 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.958450:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560545.958456:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787560545.958460:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711200, rc 0) 00000100:00100000:3.0:1787560545.958503:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+36:10338:x1874392788271104:12345-192.168.201.56@tcp:101:dd.0 Request processed in 17675us (17909us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787560545.958511:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:0.0:1787560545.966696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560545.967263:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788271488 00000100:00100000:1.0:1787560545.967274:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788271488 00000100:00100000:1.0:1787560545.967341:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:1.0:1787560545.967351:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+36:10338:x1874392788271488:12345-192.168.201.56@tcp:36:dd.0 00010000:00010000:1.0:1787560545.967614:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.967632:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560545.967644:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560545.967696:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787560545.967724:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcfcb3e1 reply state 0000000004e3bea5 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560545.967733:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560545.967827:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+39:10338:x1874392788271488:12345-192.168.201.56@tcp:36:dd.0 Request processed in 476us (1138us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787560545.967835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 52 00000020:00080000:1.0:1787560545.967839:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787560545.974289:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.974310:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.974318:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.974326:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560545.974331:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.974339:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.974358:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560545.974361:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560545.974366:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560545.974372:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f35f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.063270:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560546.393826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560546.393976:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788271616 00000100:00100000:3.0:1787560546.393987:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788271616 00000100:00100000:3.0:1787560546.394070:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:3.0:1787560546.394083:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+38:10352:x1874392788271616:12345-192.168.201.56@tcp:101:stat.0 00010000:00010000:3.0:1787560546.394112:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560546.394445:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c4400/0xe34191b05673f366 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92365 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394535:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c5400/0xe34191b05673f36d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394550:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c5400/0xe34191b05673f36d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394565:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c5400/0xe34191b05673f36d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394583:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f374 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394591:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394598:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394701:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394713:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9235e expref: 39 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394737:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394773:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9235e expref: 39 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.394787:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9235e expref: 39 pid: 11858 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560546.394800:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874392815566720:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560546.394924:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9851209c0 going to sleep for 11 seconds 00000100:00080000:2.0:1787560546.394993:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560546.397721:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874392815566720:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560546.397750:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560546.398027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560546.400649:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788271872 00000100:00100000:2.0:1787560546.400663:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788271872 00000100:00100000:2.0:1787560546.400791:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:2.0:1787560546.400803:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+40:9221:x1874392788271872:12345-192.168.201.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787560546.401231:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+41:9221:x1874392788271872:12345-192.168.201.56@tcp:35:ldlm_bl.0 Request processed in 430us (3204us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787560546.401241:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:1.0:1787560546.422831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560546.423042:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788272000 00000100:00100000:0.0:1787560546.423053:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788272000 00010000:00010000:0.0:1787560546.423096:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9235e expref: 41 pid: 11858 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560546.423176:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:0.0:1787560546.423186:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+41:2343:x1874392788272000:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560546.423202:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560546.423209:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9235e expref: 41 pid: 11858 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.423234:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9235e expref: 41 pid: 11858 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.423268:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f351 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9235e expref: 41 pid: 11858 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.423282:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:0.0:1787560546.423287:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.423297:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.423305:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.423339:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560546.423403:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+40:2343:x1874392788272000:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 218us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560546.423411:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 39 00010000:00010000:1.0:1787560546.423458:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423475:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560546.423535:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787560546.423540:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560546.423585:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423599:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423609:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c5400/0xe34191b05673f36d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423615:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c5400/0xe34191b05673f36d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423621:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c5400/0xe34191b05673f36d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423626:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c5400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560546.423631:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c5400/0xe34191b05673f36d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423638:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c5400/0xe34191b05673f36d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423647:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:1.0:1787560546.423650:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560546.423654:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c5400/0xe34191b05673f36d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423670:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c5400/0xe34191b05673f36d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423682:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f374 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423687:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f374 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423693:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423698:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dbe00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560546.423701:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423707:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f374 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423715:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d9a1269800) 00010000:00010000:1.0:1787560546.423718:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560546.423720:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f374 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423726:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f374 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423761:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9829c4400/0xe34191b05673f366 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92365 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423775:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92365 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.423788:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560546.423790:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560546.423792:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21dac00, rc 0) 00000100:00100000:1.0:1787560546.423819:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+39:10352:x1874392788271616:12345-192.168.201.56@tcp:101:stat.0 Request processed in 29740us (30005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.423826:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:2.0:1787560546.543616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560546.543752:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788272256 00000100:00100000:3.0:1787560546.543762:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788272256 00000100:00100000:3.0:1787560546.543866:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:3.0:1787560546.543885:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+39:10358:x1874392788272256:12345-192.168.201.56@tcp:36:truncate.0 00010000:00010000:3.0:1787560546.543942:0:11858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560546.543967:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f37b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92365 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.543987:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560546.543992:0:11858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560546.544591:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.544606:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.544616:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560546.544669:0:11858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787560546.544694:0:11858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f69493f reply state 0000000021774fc5 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560546.544703:0:11858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560546.544813:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+41:10358:x1874392788272256:12345-192.168.201.56@tcp:36:truncate.0 Request processed in 936us (1205us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787560546.544821:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 54 00000020:00080000:3.0:1787560546.544826:0:11858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787560546.547991:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.548007:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.548015:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.548021:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560546.548026:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.548046:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.548065:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:0.0:1787560546.548068:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560546.548073:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560546.548079:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f382 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560546.561106:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967322 is committed 00000001:00080000:3.0:1787560546.561141:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000001:00080000:3.0:1787560546.561177:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000004:00080000:3.0:1787560546.561189:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787560546.561221:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d990476f00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787560546.561226:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d98945b600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d982d65300 00000020:00080000:3.0:1787560546.561230:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d98945bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d9bb224000 00000100:00100000:2.0:1787560546.561717:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:00080000:1.0:1787560546.561753:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787560546.561870:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787560546.562195:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815566848:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787560546.562274:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560546.562774:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815566848 00000100:00100000:1.0:1787560546.562782:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815566848 00000100:00100000:2.0:1787560546.563004:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560546.563017:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874392815566848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787560546.563044:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787560546.563080:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c0261, atime: 0x6a8c0261, ctime: 0x6a8c0261, blocks: 0x1 00010000:00010000:2.0:1787560546.563088:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e75fa2d/0xe34191b05673f389 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560546.563104:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1787560546.563109:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560546.563125:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e75fa2d/0xe34191b05673f389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560546.563142:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e75fa2d/0xe34191b05673f389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560546.563164:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e75fa2d/0xe34191b05673f389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560546.563183:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e75fa2d/0xe34191b05673f389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560546.563206:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787560546.563728:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1874392815566848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 712us (1452us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787560546.563735:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787560546.563880:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560546.563888:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e75fa2d/0xe34191b05673f389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.563898:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711000 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560546.563909:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e75fa2d/0xe34191b05673f389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.563918:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e75fa2d/0xe34191b05673f389 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.563935:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e75fa2d/0xe34191b05673f389 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.563942:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e75fa2d/0xe34191b05673f389 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.563961:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560546.563963:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560546.563964:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787560546.564171:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d9b3951180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787560546.564179:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815566848:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787560546.787663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560546.788008:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788272384 00000100:00100000:1.0:1787560546.788018:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788272384 00000100:00100000:1.0:1787560546.788122:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:1.0:1787560546.788133:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+12:10372:x1874392788272384:12345-192.168.201.56@tcp:101:stat.0 00010000:00010000:1.0:1787560546.788161:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560546.788181:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f390 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9236c expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.788255:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f397 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.788269:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f397 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.788280:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f397 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.788311:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f39e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.788319:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.788325:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789100:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789111:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789120:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560546.789155:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787560546.789159:0:6706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560546.789176:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789187:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789195:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f397 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789202:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f397 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789232:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f397 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789237:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560546.789241:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f397 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789248:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f397 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789260:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:1.0:1787560546.789263:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560546.789267:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f397 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789273:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f397 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789285:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f39e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789291:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f39e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789296:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f39e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789301:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560546.789304:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f39e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789319:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f39e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789326:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d995c27e00) 00010000:00010000:1.0:1787560546.789328:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560546.789331:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f39e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789336:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f39e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789366:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f390 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9236c expref: 14 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789377:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9236c expref: 13 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560546.789384:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560546.789385:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560546.789388:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260000, rc 0) 00000100:00100000:1.0:1787560546.789453:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:10372:x1874392788272384:12345-192.168.201.56@tcp:101:stat.0 Request processed in 1321us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560546.789461:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:1.0:1787560546.883284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560546.883586:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788272640 00000100:00100000:3.0:1787560546.883595:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788272640 00000100:00100000:3.0:1787560546.883709:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:3.0:1787560546.883721:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:10382:x1874392788272640:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560546.883741:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560546.883760:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f3ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92373 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560546.884127:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787560546.884298:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f3ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92373 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.884312:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:3.0:1787560546.884321:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560546.884327:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f3ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92373 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.884339:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21dac00, rc 0) 00000100:00100000:3.0:1787560546.884460:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:10382:x1874392788272640:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 741us (1185us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787560546.884568:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:2.0:1787560546.894598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560546.896043:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788272896 00000100:00100000:0.0:1787560546.896056:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788272896 00000100:00100000:0.0:1787560546.896141:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:0.0:1787560546.896153:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:10382:x1874392788272896:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560546.896636:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:10382:x1874392788272896:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 483us (2048us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787560546.896645:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:0.0:1787560546.998348:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560546.998633:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788273152 00000100:00100000:3.0:1787560546.998647:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788273152 00000100:00100000:3.0:1787560546.998726:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:3.0:1787560546.998751:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:10388:x1874392788273152:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1787560546.998788:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560546.998816:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f3ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9237a expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.999241:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.999262:0:11858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9236c expref: 16 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.999272:0:11858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.999320:0:11858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9236c expref: 16 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560546.999337:0:11858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9236c expref: 16 pid: 6706 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560546.999437:0:11858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815566976:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560546.999651:0:11858:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98555b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787560547.008070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560547.008172:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788273280 00000100:00100000:2.0:1787560547.008182:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788273280 00010000:00010000:2.0:1787560547.008238:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9236c expref: 17 pid: 6706 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560547.008285:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 40 00000100:00100000:2.0:1787560547.008295:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:2343:x1874392788273280:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560547.008310:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560547.008317:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9236c expref: 17 pid: 6706 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.008330:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9236c expref: 17 pid: 6706 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.008350:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:2.0:1787560547.008355:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.008378:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.008385:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.008402:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560547.008453:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:2343:x1874392788273280:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 159us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560547.008460:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 40 00010000:00010000:3.0:1787560547.008690:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f3a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9236c expref: 16 pid: 6706 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560547.008707:0:11858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815566976:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560547.008728:0:11858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.008737:0:11858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.008742:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560547.008762:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787560547.008955:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f3ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9237a expref: 17 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.008969:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9237a expref: 16 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.008976:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560547.008978:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787560547.008981:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db200, rc 0) 00000100:00100000:3.0:1787560547.009060:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:10388:x1874392788273152:12345-192.168.201.56@tcp:101:bash.0 Request processed in 10324us (10727us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787560547.009074:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:1.0:1787560547.015070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560547.015165:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788273536 00000100:00100000:2.0:1787560547.015176:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788273536 00000100:00100000:2.0:1787560547.015244:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:2.0:1787560547.015263:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:10388:x1874392788273536:12345-192.168.201.56@tcp:36:bash.0 00010000:00010000:2.0:1787560547.015541:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.015557:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.015569:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560547.015616:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787560547.015639:0:6706:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004159d2fc reply state 00000000449ea704 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560547.015648:0:6706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560547.015740:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10388:x1874392788273536:12345-192.168.201.56@tcp:36:bash.0 Request processed in 487us (680us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787560547.015764:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00000020:00080000:2.0:1787560547.015770:0:6706:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787560547.023169:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.023187:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.023194:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.023200:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560547.023219:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.023228:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.023244:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560547.023247:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560547.023260:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.023266:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f3cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560547.024698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.024773:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788273664 00000100:00100000:3.0:1787560547.024783:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788273664 00000100:00100000:3.0:1787560547.024841:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:3.0:1787560547.024883:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+18:10388:x1874392788273664:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1787560547.024907:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560547.024939:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f3d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92381 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.025016:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.025031:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9237a expref: 19 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.025039:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.025071:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9237a expref: 19 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.025083:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9237a expref: 19 pid: 11858 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560547.025097:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874392815567104:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560547.025179:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98555b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560547.028727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.029010:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788273792 00000100:00100000:0.0:1787560547.029020:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788273792 00010000:00010000:0.0:1787560547.029063:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9237a expref: 20 pid: 11858 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560547.029107:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00100000:0.0:1787560547.029117:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:2342:x1874392788273792:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560547.029132:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560547.029148:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9237a expref: 20 pid: 11858 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.029162:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9237a expref: 20 pid: 11858 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.029185:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:0.0:1787560547.029190:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.029200:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.029219:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.029241:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560547.029449:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:2342:x1874392788273792:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 333us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560547.029457:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 41 00010000:00010000:3.0:1787560547.029647:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f3c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9237a expref: 19 pid: 11858 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560547.029663:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874392815567104:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560547.029684:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.029692:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.029710:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560547.029754:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787560547.029758:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560547.029781:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.029810:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f3d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92381 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.029823:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92381 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.029830:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560547.029833:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560547.029835:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db800, rc 0) 00000100:00100000:3.0:1787560547.029907:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+18:10388:x1874392788273664:12345-192.168.201.56@tcp:101:bash.0 Request processed in 5027us (5216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560547.029913:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:2.0:1787560547.034577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560547.034673:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788274048 00000100:00100000:1.0:1787560547.034683:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788274048 00000100:00100000:1.0:1787560547.034791:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:1.0:1787560547.034802:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae747450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+18:10388:x1874392788274048:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:1.0:1787560547.035076:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae747450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10388:x1874392788274048:12345-192.168.201.56@tcp:35:bash.0 Request processed in 274us (618us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787560547.035084:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00010000:00010000:0.0:1787560547.088621:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560547.135193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.136178:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788274304 00000100:00100000:3.0:1787560547.136190:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788274304 00000100:00100000:2.0:1787560547.136607:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:2.0:1787560547.136618:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10398:x1874392788274304:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560547.136641:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560547.136662:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f3e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92388 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560547.136926:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787560547.137086:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f3e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92388 expref: 21 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.137101:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:2.0:1787560547.137103:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560547.137109:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f3e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92388 expref: 21 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.137122:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711800, rc 0) 00000100:00100000:2.0:1787560547.137193:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:10398:x1874392788274304:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 577us (2009us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787560547.137451:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:3.0:1787560547.141235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560547.141695:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788274432 00000100:00100000:1.0:1787560547.141705:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788274432 00000100:00100000:1.0:1787560547.141749:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:1.0:1787560547.141758:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:10398:x1874392788274432:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:1.0:1787560547.141826:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f3f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.141841:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f3f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.141865:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f3f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.142003:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f3f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.142011:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.142018:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.142990:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143008:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143018:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560547.143058:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143069:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f3f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143076:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f3f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143083:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f3f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143089:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560547.143093:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f3f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143100:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f3f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143110:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:1.0:1787560547.143113:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560547.143118:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f3f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143123:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f3f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143140:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143147:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f3f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143152:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143157:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560547.143160:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143166:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f3f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143173:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d995c27e00) 00010000:00010000:1.0:1787560547.143175:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560547.143177:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f3f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143183:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f3f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143195:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143210:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143216:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143443:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560547.143447:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143454:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143652:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560547.143656:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560547.143659:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.143665:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f400 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560547.143815:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:10398:x1874392788274432:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 2053us (2585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560547.143825:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:0.0:1787560547.147018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560547.147130:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788274688 00000100:00100000:2.0:1787560547.147139:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788274688 00000100:00100000:2.0:1787560547.147190:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:2.0:1787560547.147210:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:10398:x1874392788274688:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:2.0:1787560547.148103:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:10398:x1874392788274688:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 900us (1091us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787560547.148113:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:0.0:1787560547.198938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.199085:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788274944 00000100:00100000:3.0:1787560547.199095:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788274944 00000100:00100000:3.0:1787560547.199156:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:3.0:1787560547.199167:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:10401:x1874392788274944:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560547.199194:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560547.199236:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f407 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9238f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.199324:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f40e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.199338:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f40e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.199348:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f40e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.199362:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f415 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.199369:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.199375:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.199964:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f41c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.199975:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f41c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.199983:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f41c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560547.199993:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787560547.200082:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f40e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200099:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f40e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200106:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f40e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200112:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dac00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560547.200117:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f40e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200124:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f40e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200136:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:3.0:1787560547.200139:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560547.200143:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f40e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200149:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05673f40e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200162:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200167:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f415 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200173:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200178:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560547.200188:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200193:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f415 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200211:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d9a1269600) 00010000:00010000:3.0:1787560547.200214:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560547.200217:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f415 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200222:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05673f415 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200398:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da000/0xe34191b05673f407 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9238f expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200414:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f41c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9238f expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.200421:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560547.200423:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560547.200426:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21dbe00, rc 0) 00000100:00100000:3.0:1787560547.200665:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:10401:x1874392788274944:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1499us (1735us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787560547.200671:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:3.0:1787560547.205611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.205686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560547.205746:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788275200 00000100:00100000:2.0:1787560547.205756:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788275200 00000100:00100000:2.0:1787560547.205820:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:2.0:1787560547.205830:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:2343:x1874392788275200:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560547.205866:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560547.205891:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbe00/0xe34191b05673f41c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9238f expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.205909:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:2.0:1787560547.205914:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560547.205965:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:2343:x1874392788275200:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 137us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560547.205973:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:1.0:1787560547.207611:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788275072 00000100:00100000:1.0:1787560547.207625:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788275072 00000100:00100000:1.0:1787560547.207722:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:1.0:1787560547.207734:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:10401:x1874392788275072:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:1.0:1787560547.207801:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f42a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.207816:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.207827:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.207894:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.207901:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f42a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.207907:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f42a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.207913:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560547.207917:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f42a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.207924:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f42a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.207935:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560547.207938:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560547.207943:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f42a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.207949:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f42a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560547.208021:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:10401:x1874392788275072:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 289us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560547.208029:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:3.0:1787560547.211660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.211732:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788275456 00000100:00100000:0.0:1787560547.211742:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788275456 00000100:00100000:0.0:1787560547.211799:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:0.0:1787560547.211807:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:10401:x1874392788275456:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560547.212063:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:10401:x1874392788275456:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 255us (409us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787560547.212092:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:0.0:1787560547.399148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.399230:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788275712 00000100:00100000:3.0:1787560547.399253:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788275712 00000100:00100000:3.0:1787560547.399306:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:3.0:1787560547.399315:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:10420:x1874392788275712:12345-192.168.201.56@tcp:101:cat.0 00010000:00010000:3.0:1787560547.399339:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560547.399358:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f431 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92396 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.399466:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673f438 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.399479:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673f438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.399492:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673f438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560547.399508:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787560547.399626:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f431 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92396 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.399647:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673f438 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92396 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.399656:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560547.399659:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787560547.399662:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eaa00, rc 0) 00000100:00100000:3.0:1787560547.399717:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10420:x1874392788275712:12345-192.168.201.56@tcp:101:cat.0 Request processed in 403us (578us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787560547.399724:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:0.0:1787560547.424563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.424736:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788275840 00000100:00100000:3.0:1787560547.424746:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788275840 00000100:00100000:3.0:1787560547.424807:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:3.0:1787560547.424818:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10421:x1874392788275840:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560547.424843:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560547.424902:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9239d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.424996:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f44d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.425010:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f44d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.425020:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f44d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560547.425225:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787560547.425229:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560547.425312:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f44d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.425340:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9239d expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.425359:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f44d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9239d expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.425367:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:3.0:1787560547.425369:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560547.425378:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eae00, rc 0) 00000100:00100000:3.0:1787560547.425439:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10421:x1874392788275840:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 623us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560547.425446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:1.0:1787560547.434944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.435093:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788276224 00000100:00100000:0.0:1787560547.435104:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788276224 00000100:00100000:0.0:1787560547.435171:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:0.0:1787560547.435182:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10421:x1874392788276224:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560547.436155:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10421:x1874392788276224:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 970us (1216us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787560547.436167:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:0.0:1787560547.439672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560547.439829:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788276352 00000100:00100000:1.0:1787560547.439840:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788276352 00000100:00100000:1.0:1787560547.440068:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:1.0:1787560547.440079:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3950700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10421:x1874392788276352:12345-192.168.201.56@tcp:103:lfs.0 00010000:00010000:1.0:1787560547.440096:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787560547.440121:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b05673f3dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92381 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.440144:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673f438 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92396 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.440160:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f2e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92342 expref: 25 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560547.440170:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560547.440180:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560547.440408:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3950700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:10421:x1874392788276352:12345-192.168.201.56@tcp:103:lfs.0 Request processed in 173us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560547.440418:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:1.0:1787560547.444000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560547.445349:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788276480 00000100:00100000:2.0:1787560547.445362:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788276480 00000100:00100000:2.0:1787560547.445435:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:2.0:1787560547.445446:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:10421:x1874392788276480:12345-192.168.201.56@tcp:58:lfs.0 00010000:00010000:2.0:1787560547.445577:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f454 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.445594:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.445605:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560547.447064:0:6706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560547.447968:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787560547.448045:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787560547.448183:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:10421:x1874392788276480:12345-192.168.201.56@tcp:58:lfs.0 Request processed in 2733us (4339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560547.448225:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:3.0:1787560547.472089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.472299:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788276608 00000100:00100000:0.0:1787560547.472309:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788276608 00000100:00100000:0.0:1787560547.472370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 67 00000100:00100000:0.0:1787560547.472381:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:10423:x1874392788276608:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560547.472400:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560547.472422:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f45b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923a4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472494:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f462 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472518:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f462 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472531:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f462 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472564:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472571:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472578:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472839:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472898:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472907:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560547.472940:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787560547.472944:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560547.472961:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472972:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472980:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f462 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.472986:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f462 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473002:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f462 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473007:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560547.473011:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f462 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473018:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f462 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473029:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:0.0:1787560547.473033:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560547.473037:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f462 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473043:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f462 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473055:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473061:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f469 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473066:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473071:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560547.473073:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473087:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f469 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473096:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d987fb3c00) 00010000:00010000:0.0:1787560547.473098:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560547.473101:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f469 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473107:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473139:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b05673f45b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923a4 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473153:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923a4 expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.473159:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52400) 00010000:00010000:0.0:1787560547.473161:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560547.473163:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2044400, rc 0) 00000100:00100000:0.0:1787560547.473230:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10423:x1874392788276608:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 851us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560547.473238:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 67 00000040:00080000:3.0:1787560547.535099:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560547.535110:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560547.535177:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787560547.535183:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787560547.535332:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815567232:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787560547.535428:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98555bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560547.536589:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815567488:0@lo:400:kworker.0 00000100:00100000:2.0:1787560547.536638:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560547.536662:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815568000:0@lo:400:kworker.0 00000100:00100000:2.0:1787560547.536688:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560547.536709:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560547.536715:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815567616:0@lo:400:kworker.0 00000100:00100000:2.0:1787560547.536756:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560547.536765:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815567744:0@lo:400:kworker.0 00000100:00100000:0.0:1787560547.536793:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560547.536827:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787560547.536833:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815567360:0@lo:400:kworker.0 00000100:00100000:0.0:1787560547.536884:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560547.536908:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815567872:0@lo:400:kworker.0 00000100:00100000:0.0:1787560547.536928:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560547.537063:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815567360 00000100:00100000:3.0:1787560547.537072:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815567360 00000100:00100000:3.0:1787560547.537119:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787560547.537129:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815567360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560547.537177:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98328a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815567360:12345-0@lo:400:kworker.0 Request processed in 50us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560547.537184:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787560547.537209:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815567360:0@lo:400:kworker.0 00000100:00100000:0.0:1787560547.537235:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815568000 00000100:00100000:0.0:1787560547.537238:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815568000 00000100:00100000:0.0:1787560547.537273:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815567744 00000100:00100000:0.0:1787560547.537276:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815567744 00000100:00100000:3.0:1787560547.537363:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815567488 00000100:00100000:3.0:1787560547.537367:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815567488 00000100:00100000:3.0:1787560547.537391:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815567616 00000100:00100000:3.0:1787560547.537394:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815567616 00000100:00100000:3.0:1787560547.537412:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815567872 00000100:00100000:3.0:1787560547.537415:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815567872 00000100:00100000:3.0:1787560547.537431:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787560547.537438:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815567488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560547.537476:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815567488:12345-0@lo:400:kworker.0 Request processed in 39us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560547.537507:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787560547.537520:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787560547.537528:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815567616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560547.537557:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815567616:12345-0@lo:400:kworker.0 Request processed in 31us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560547.537564:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787560547.537577:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787560547.537584:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815567872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560547.537615:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815567872:12345-0@lo:400:kworker.0 Request processed in 32us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560547.537622:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787560547.537650:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815567872:0@lo:400:kworker.0 00000100:00080000:3.0:1787560547.537688:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560547.537692:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560547.537694:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560547.537827:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815567616:0@lo:400:kworker.0 00000100:00100000:3.0:1787560547.537838:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815567488:0@lo:400:kworker.0 00000100:00100000:0.0:1787560547.542031:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787560547.542062:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874392815568000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560547.542178:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874392815568000:12345-0@lo:400:kworker.0 Request processed in 133us (5489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560547.542186:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787560547.542220:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787560547.542228:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815567744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560547.542290:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815567744:12345-0@lo:400:kworker.0 Request processed in 63us (5496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560547.542296:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787560547.542608:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815568000:0@lo:400:kworker.0 00000100:00100000:1.0:1787560547.542653:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815567744:0@lo:400:kworker.0 00000100:00100000:3.0:1787560547.544016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.544057:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815567232:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787560547.544571:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788276736 00000100:00100000:1.0:1787560547.544579:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788276736 00000100:00100000:1.0:1787560547.544628:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:1.0:1787560547.544637:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10434:x1874392788276736:12345-192.168.201.56@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787560547.544704:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10434:x1874392788276736:12345-192.168.201.56@tcp:900:lhsmtool_posix.0 Request processed in 67us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560547.544721:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:0.0:1787560547.549117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.549239:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788276864 00000100:00100000:3.0:1787560547.549249:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788276864 00000100:00100000:3.0:1787560547.549308:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 68 00000100:00100000:3.0:1787560547.549320:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10434:x1874392788276864:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787560547.549352:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787560547.549472:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10434:x1874392788276864:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 154us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560547.549479:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 68 00000100:00100000:1.0:1787560547.558707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.559004:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788276992 00000100:00100000:3.0:1787560547.559016:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788276992 00000100:00100000:3.0:1787560547.559079:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:3.0:1787560547.559090:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10434:x1874392788276992:12345-192.168.201.56@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787560547.559170:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f477 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559187:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f477 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559212:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f477 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559230:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f47e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559238:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f47e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559245:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f47e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559272:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559281:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559287:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560547.559337:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787560547.559341:0:11858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560547.559356:0:11858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559367:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f477 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559372:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f477 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559378:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f477 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559384:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebe00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560547.559388:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f477 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559395:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f477 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559406:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:3.0:1787560547.559409:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560547.559413:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f477 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559419:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f477 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559435:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f47e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559460:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f47e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559467:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f47e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559472:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560547.559475:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f47e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559481:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f47e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559489:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff93d9a1269600) 00010000:00010000:3.0:1787560547.559491:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560547.559494:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f47e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559499:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f47e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559514:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559520:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559526:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559532:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560547.559540:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559546:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559554:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52400) 00010000:00010000:3.0:1787560547.559556:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560547.559559:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.559565:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560547.559699:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10434:x1874392788276992:12345-192.168.201.56@tcp:34:lhsmtool_posix.0 Request processed in 609us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560547.559708:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:1.0:1787560547.568287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560547.568365:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788277248 00000100:00100000:2.0:1787560547.568376:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788277248 00000100:00100000:2.0:1787560547.568433:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:2.0:1787560547.568444:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10434:x1874392788277248:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560547.568474:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560547.568497:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f48c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568620:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568633:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568654:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560547.568665:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787560547.568759:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568766:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f493 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568772:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568777:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560547.568781:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568789:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f493 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568801:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52400) 00010000:00010000:2.0:1787560547.568816:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560547.568822:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f493 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568828:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568912:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f48c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ab expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568934:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:2.0:1787560547.568937:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560547.568941:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f48c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ab expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.568957:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710800, rc 0) 00000100:00100000:2.0:1787560547.569024:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10434:x1874392788277248:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 583us (747us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787560547.569031:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:0.0:1787560547.584170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.584269:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788277376 00000100:00100000:3.0:1787560547.584279:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788277376 00000100:00100000:3.0:1787560547.584338:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 71 00000100:00100000:3.0:1787560547.584349:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10434:x1874392788277376:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787560547.584384:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787560547.584498:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10434:x1874392788277376:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 149us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560547.584505:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 71 00000100:00100000:1.0:1787560547.587531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.587622:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788277632 00000100:00100000:3.0:1787560547.587632:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788277632 00000100:00100000:3.0:1787560547.587692:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00100000:3.0:1787560547.587703:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10434:x1874392788277632:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560547.587737:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560547.587741:0:11858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787560547.587768:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f44d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9239d expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.587790:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:3.0:1787560547.587795:0:11858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560547.587807:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f4a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923b2 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787560547.588618:0:11858:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787560547.591144:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f4a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.591167:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.591179:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f4a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.591263:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f4a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b2 expref: 28 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.591287:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f4a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b2 expref: 27 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.591296:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d9a1269600) 00010000:00010000:3.0:1787560547.591299:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560547.591316:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb800, rc 0) 00000100:00100000:3.0:1787560547.591382:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10434:x1874392788277632:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 3679us (3860us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787560547.591391:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00100000:3.0:1787560547.598777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.601342:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788277888 00000100:00100000:0.0:1787560547.601360:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788277888 00000100:00100000:0.0:1787560547.601428:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 73 00000100:00100000:0.0:1787560547.601451:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10434:x1874392788277888:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787560547.601514:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560547.601542:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673f4a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b2 expref: 27 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.601572:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d9a1269600) 00010000:00010000:0.0:1787560547.601584:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560547.601609:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f4b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.601622:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.601631:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.601684:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe9615b26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.601692:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe9615b26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.601698:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe9615b26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602020:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f4b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602028:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f4b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602034:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f4b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602039:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560547.602043:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f4b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602057:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f4b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602067:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:0.0:1787560547.602070:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560547.602074:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f4b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602079:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b05673f4b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602088:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe9615b26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602093:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe9615b26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602098:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe9615b26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602102:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560547.602105:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe9615b26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602110:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe9615b26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602116:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe9615b26 (ffff93d987fb3c00) 00010000:00010000:0.0:1787560547.602119:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560547.602122:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe9615b26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.602136:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe9615b26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560547.602246:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10434:x1874392788277888:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 808us (3482us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560547.602265:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 73 00000100:00100000:0.0:1787560547.605083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560547.605729:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788278016 00000100:00100000:2.0:1787560547.605744:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788278016 00000100:00100000:2.0:1787560547.605818:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:2.0:1787560547.605831:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10434:x1874392788278016:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560547.605890:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560547.605916:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f4c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923b9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.605955:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.605970:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.605982:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.606079:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f4c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b9 expref: 28 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.606107:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b9 expref: 27 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.606116:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:2.0:1787560547.606119:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560547.606123:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711a00, rc 0) 00000100:00100000:2.0:1787560547.606205:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10434:x1874392788278016:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 365us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560547.606213:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:3.0:1787560547.609840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560547.610287:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788278272 00000100:00100000:2.0:1787560547.610301:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788278272 00000100:00100000:2.0:1787560547.610363:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:2.0:1787560547.610374:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10434:x1874392788278272:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787560547.610458:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.610476:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.610487:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560547.610774:0:11858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1787560547.610787:0:11858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376363938829ns, next at 377363935354ns, rc = 0 00000004:00010000:2.0:1787560547.610901:0:11858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000106691fc reply state 00000000edce5f08 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560547.610925:0:11858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560547.611031:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:10434:x1874392788278272:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 659us (1206us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787560547.611039:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 75 00010000:00010000:0.0:1787560547.615742:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.615770:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.615780:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.615789:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560547.615796:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.615806:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.615829:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:0.0:1787560547.615832:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787560547.615838:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.615844:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f4d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560547.616788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.620727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788278400 00000100:00100000:0.0:1787560547.620748:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788278400 00000100:00100000:0.0:1787560547.620921:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:0.0:1787560547.620935:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+28:10434:x1874392788278400:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560547.620971:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560547.620999:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.621080:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c0 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.621097:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c0 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.621122:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:0.0:1787560547.621126:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560547.621130:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2044600, rc 0) 00000100:00100000:0.0:1787560547.621233:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:10434:x1874392788278400:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 300us (4456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560547.621241:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:3.0:1787560547.627961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560547.628575:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788278528 00000100:00100000:2.0:1787560547.628593:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788278528 00000100:00100000:2.0:1787560547.628656:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:2.0:1787560547.628666:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1874392788278528:12345-192.168.201.56@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787560547.628718:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:2.0:1787560547.628752:0:6684:0:(genops.c:1385:class_connect()) connect: client 3e6b7760-d76b-45e8-8d98-861d14ecc789, cookie 0xe34191b05673f4e0 00002000:00100000:2.0:1787560547.628765:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e6b7760-d76b-45e8-8d98-861d14ecc789/ffff93d9b3810000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787560547.628788:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787560547.629034:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787560547.629066:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93d9b3816800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560547.629140:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2341:x1874392788278528:12345-192.168.201.56@tcp:8:lhsmtool_posix.0 Request processed in 473us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560547.629148:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:0.0:1787560547.635995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.636350:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788278656 00000100:00100000:3.0:1787560547.636368:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788278656 00000100:00080000:2.0:1787560547.636481:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560547.636697:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:3.0:1787560547.636716:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:0:x1874392788278656:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787560547.721253:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:0:x1874392788278656:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 Request processed in 84531us (85257us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787560547.721270:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 26 00000001:00100000:1.0:1787560547.721319:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000001:00080000:1.0:1787560547.721338:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1787560547.729973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.730037:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788278912 00000100:00100000:0.0:1787560547.730051:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788278912 00000100:00100000:0.0:1787560547.730113:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:0.0:1787560547.730123:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:10434:x1874392788278912:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787560547.730352:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:10434:x1874392788278912:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 230us (395us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787560547.730368:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:3.0:1787560547.740281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.740513:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788279168 00000100:00100000:0.0:1787560547.740523:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788279168 00000100:00100000:0.0:1787560547.740585:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 77 00000100:00100000:0.0:1787560547.740596:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:10434:x1874392788279168:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787560547.740698:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:10434:x1874392788279168:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 105us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560547.740704:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 77 00000100:00100000:1.0:1787560547.744367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.744465:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788279296 00000100:00100000:3.0:1787560547.744474:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788279296 00000100:00100000:3.0:1787560547.744528:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:3.0:1787560547.744538:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:10434:x1874392788279296:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560547.744556:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560547.744575:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f4e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923c7 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.744636:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f4ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.744650:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.744660:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560547.744704:0:11858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560547.744719:0:11858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f4ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.744743:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f4e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c7 expref: 32 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.744763:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f4ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c7 expref: 31 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560547.744772:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560547.744775:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787560547.744778:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea800, rc 0) 00000100:00100000:3.0:1787560547.745143:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:10434:x1874392788279296:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 604us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560547.745151:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:1.0:1787560547.748788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.748947:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788279424 00000100:00100000:0.0:1787560547.748958:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788279424 00000100:00100000:0.0:1787560547.749018:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:0.0:1787560547.749028:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788279424:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560547.749045:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560547.749067:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b05673f4f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923ce expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560547.749096:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c0263, blocks: 0x1 00010000:00010000:0.0:1787560547.749116:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1787560547.749121:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560547.749130:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b05673f4f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ce expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.749147:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b05673f4f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ce expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.749180:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2045e00, rc 0) 00000100:00100000:0.0:1787560547.749268:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788279424:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 241us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560547.749275:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:2.0:1787560547.754591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.754787:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788279680 00000100:00100000:0.0:1787560547.754797:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788279680 00000100:00100000:0.0:1787560547.754936:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00100000:0.0:1787560547.754946:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:10434:x1874392788279680:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787560547.755202:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:10434:x1874392788279680:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 247us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560547.755210:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00100000:1.0:1787560547.760652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.760805:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788279808 00000100:00100000:0.0:1787560547.760816:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788279808 00000100:00100000:0.0:1787560547.760891:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:0.0:1787560547.760902:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:10434:x1874392788279808:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560547.760922:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560547.760941:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923d5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.760974:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b05673f4f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ce expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.760984:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560547.760988:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560547.760993:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.761048:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b05673f4f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ce expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.761059:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b05673f4f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ce expref: 7 pid: 6685 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560547.761073:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3952680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874392815568128:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560547.761158:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38fa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560547.783051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.784837:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3952680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874392815568128:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560547.784921:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560547.784945:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2044c00, rc 0) 00000100:00100000:0.0:1787560547.785009:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:10434:x1874392788279808:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 24108us (24367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560547.785018:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:2.0:1787560547.785140:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788279936 00000100:00100000:2.0:1787560547.785148:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788279936 00010000:00010000:2.0:1787560547.785182:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b05673f4f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ce expref: 7 pid: 6685 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560547.785239:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:2.0:1787560547.785248:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e10050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2343:x1874392788279936:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560547.785262:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560547.785284:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b05673f4f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ce expref: 7 pid: 6685 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.785298:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b05673f4f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ce expref: 7 pid: 6685 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.785322:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b05673f4f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ce expref: 7 pid: 6685 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.785337:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560547.785342:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560547.785349:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.785359:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560547.785391:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560547.785404:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4531c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874392815568256:192.168.201.56@tcp:105: 00000100:00100000:2.0:1787560547.785469:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560547.790579:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4531c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874392815568256:192.168.201.56@tcp:105: 00010000:00010000:2.0:1787560547.790609:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560547.790669:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e10050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788279936:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 5421us (7628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560547.790681:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:1.0:1787560547.794586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560547.794841:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788280064 00000100:00100000:2.0:1787560547.795004:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788280064 00002000:00100000:2.0:1787560547.795054:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93d99012df80 x1874392788280064/t0(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:663/0 lens 504/0 e 0 to 0 dl 1787560558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560547.795131:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d99012df80 with x1874392788280064 ext(0->8) 00002000:00010000:2.0:1787560547.795137:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d99012df80 00000100:00100000:2.0:1787560547.795161:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:2.0:1787560547.795171:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788280064:12345-192.168.201.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787560547.796289:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2345:x1874392788280064:12345-192.168.201.56@tcp:4:lhsmtool_posix.0 Request processed in 1116us (1708us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787560547.796299:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00002000:00100000:2.0:1787560547.796309:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff93d99012df80 x1874392788280064/t4294967302(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:663/0 lens 504/448 e 0 to 0 dl 1787560558 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560547.796319:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d99012df80 with x1874392788280064 ext(0->8) 00002000:00010000:2.0:1787560547.796323:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d99012df80 00000100:00100000:1.0:1787560547.809083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560547.809456:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788280192 00000100:00100000:0.0:1787560547.809479:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788280192 00000100:00100000:0.0:1787560547.809571:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00100000:0.0:1787560547.809585:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:10434:x1874392788280192:12345-192.168.201.56@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787560547.947418:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1787560547.947536:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1787560547.947564:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787560547.947739:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1787560547.947754:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787560547.948829:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:10434:x1874392788280192:12345-192.168.201.56@tcp:44:lhsmtool_posix.0 Request processed in 139234us (139754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560547.948843:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00100000:2.0:1787560547.955506:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815568384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787560547.955608:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560547.955721:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815568384 00000100:00100000:2.0:1787560547.955744:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815568384 00000100:00100000:2.0:1787560547.955817:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560547.955830:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815568384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787560547.956050:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787560547.956054:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787560547 00002000:00010000:2.0:1787560547.956057:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787560547.956060:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787560547 -> 1787560547 00002000:00010000:2.0:1787560547.956062:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787560547.956108:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815568384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 280us (499us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787560547.956116:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1787560547.956166:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d9b4531c00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787560547.956173:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815568384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787560547.960932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560547.961031:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788280320 00000100:00100000:3.0:1787560547.961044:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788280320 00000100:00100000:3.0:1787560547.961122:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:3.0:1787560547.961136:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2342:x1874392788280320:12345-192.168.201.56@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787560548.051987:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815568512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560548.052086:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560548.052312:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815568512 00000100:00100000:0.0:1787560548.052322:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815568512 00000100:00100000:0.0:1787560548.052394:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787560548.052405:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874392815568512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560548.052450:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560548.052509:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874392815568512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560548.052517:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787560548.052581:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815568512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560548.076774:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2342:x1874392788280320:12345-192.168.201.56@tcp:16:lhsmtool_posix.0 Request processed in 115624us (115841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560548.076799:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00000001:00080000:3.0:1787560548.076865:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1787560548.076877:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1787560548.080668:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560548.080714:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788280576 00000100:00100000:3.0:1787560548.080726:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788280576 00000100:00100000:3.0:1787560548.080803:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 81 00000100:00100000:3.0:1787560548.080815:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:10434:x1874392788280576:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787560548.080900:0:11858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560548.080935:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f4ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c7 expref: 13 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.080959:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560548.080967:0:11858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560548.081025:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.081040:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.081051:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560548.081444:0:11858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003cc0679 reply state 0000000053c89111 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560548.081455:0:11858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560548.081575:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:10434:x1874392788280576:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 762us (921us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787560548.081604:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 81 00000100:00080000:2.0:1787560548.081955:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787560548.086480:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.086504:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.086513:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.086520:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebe00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560548.086525:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.086534:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.086556:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:3.0:1787560548.086560:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560548.086566:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.086572:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f503 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560548.093121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.093232:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788280704 00000100:00100000:0.0:1787560548.093246:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788280704 00000100:00100000:0.0:1787560548.093325:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:0.0:1787560548.093338:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788280704:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787560548.093693:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787560548.093697:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787560547 -> 1787560547 00002000:00010000:0.0:1787560548.093700:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787560545 00002000:00010000:0.0:1787560548.093703:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787560547 -> 1787560547 00002000:00010000:0.0:1787560548.093705:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787560548.093785:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788280704:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 Request processed in 449us (678us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787560548.093794:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:0.0:1787560548.096161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560548.096395:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788280960 00000100:00100000:2.0:1787560548.096407:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788280960 00000100:00100000:2.0:1787560548.096483:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:2.0:1787560548.096496:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:10434:x1874392788280960:12345-192.168.201.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787560548.096595:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.096617:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b9 expref: 13 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.096630:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.096675:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b9 expref: 13 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.096711:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b9 expref: 13 pid: 6706 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560548.096731:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4533100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874392815568640:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560548.096878:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560548.100138:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4533100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874392815568640:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560548.100178:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560548.108771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.109295:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788281088 00000100:00100000:0.0:1787560548.109308:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788281088 00010000:00010000:0.0:1787560548.109357:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b9 expref: 14 pid: 6706 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560548.109432:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:0.0:1787560548.109453:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:2342:x1874392788281088:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560548.109472:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560548.109480:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b9 expref: 14 pid: 6706 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.109504:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b9 expref: 14 pid: 6706 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.109532:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f4cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923b9 expref: 14 pid: 6706 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.109549:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:0.0:1787560548.109554:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.109565:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.109573:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.109601:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560548.109670:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:2342:x1874392788281088:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 228us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560548.109677:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 43 00010000:00010000:2.0:1787560548.109793:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.109803:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.109840:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.109868:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.109876:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.109883:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560548.109888:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.109897:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.109916:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:2.0:1787560548.109919:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787560548.109924:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.109931:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673f50a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560548.109987:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+12:10434:x1874392788280960:12345-192.168.201.56@tcp:55:lhsmtool_posix.0 Request processed in 13493us (13838us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787560548.109996:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 82 00010000:00010000:1.0:1787560548.120628:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560548.122452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560548.122590:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788281216 00000100:00100000:1.0:1787560548.122603:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788281216 00000100:00100000:1.0:1787560548.122687:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00100000:1.0:1787560548.122700:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2343:x1874392788281216:12345-192.168.201.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787560548.122767:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.122803:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.122812:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560548.122818:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787560548.122824:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.122890:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.122908:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 7 pid: 6683 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560548.122926:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874392815568768:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560548.123042:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bf9dd840 going to sleep for 11 seconds 00000100:00100000:3.0:1787560548.127286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560548.127493:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788281344 00000100:00100000:2.0:1787560548.127506:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788281344 00010000:00010000:2.0:1787560548.127557:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 8 pid: 6683 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560548.127608:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:2.0:1787560548.127620:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788281344:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560548.127653:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560548.127685:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 8 pid: 6683 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.127704:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 8 pid: 6683 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.127783:0:7630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560548.127802:0:7630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560548.127809:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.127820:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.127871:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560548.127939:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788281344:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 320us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560548.127946:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 44 00010000:00010000:0.0:1787560548.131965:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05673f4fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923d5 expref: 7 pid: 6683 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560548.132008:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874392815568768:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560548.132049:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.132061:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.132134:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.132197:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.132363:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.132375:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.132383:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261200 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560548.132388:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.132398:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.132429:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.132438:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673f511 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560548.132565:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788281216:12345-192.168.201.56@tcp:1:lhsmtool_posix.0 Request processed in 9866us (10126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560548.132577:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00100000:3.0:1787560548.136230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.136366:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788281600 00000100:00100000:0.0:1787560548.136380:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788281600 00000100:00100000:0.0:1787560548.136459:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:0.0:1787560548.136471:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+12:10434:x1874392788281600:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787560548.136589:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f518 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.136611:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f518 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.136626:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f518 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.136944:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.136958:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c0 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.136986:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.137027:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c0 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.137045:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c0 expref: 13 pid: 5838 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560548.137062:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3952300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815568896:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560548.137170:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560548.149695:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.149779:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3952300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815568896:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560548.149795:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788281728 00000100:00100000:1.0:1787560548.149803:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788281728 00010000:00010000:0.0:1787560548.149818:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.149902:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c0 expref: 14 pid: 5838 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560548.149982:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:0.0:1787560548.149995:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:2343:x1874392788281728:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560548.150013:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560548.150021:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c0 expref: 14 pid: 5838 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.150034:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c0 expref: 14 pid: 5838 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.150061:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05673f4d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923c0 expref: 14 pid: 5838 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.150086:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:0.0:1787560548.150091:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.150101:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.150111:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.150139:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560548.150162:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.150169:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560548.150328:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:2343:x1874392788281728:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 335us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560548.150336:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 45 00000001:00080000:1.0:1787560548.150441:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787560548.150735:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787560548.150786:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787560548.150906:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6706:1874392815569024:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787560548.150968:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560548.151004:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bf9dd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560548.151035:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815569024 00000100:00100000:1.0:1787560548.151042:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815569024 00000100:00100000:1.0:1787560548.151081:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560548.151089:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6706:x1874392815569024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787560548.151167:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6706:x1874392815569024:12345-0@lo:1000:mdt00_003.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560548.151174:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560548.151218:0:6706:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787560548.151225:0:6706:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d9b4531c00, transno 4294967303 00000100:00100000:1.0:1787560548.151240:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6706:1874392815569024:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787560548.151746:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787560548.151806:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6706:1874392815569152:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787560548.151884:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560548.151901:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bf9dd840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560548.151920:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815569152 00000100:00100000:1.0:1787560548.151924:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815569152 00000100:00100000:1.0:1787560548.151944:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560548.151951:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6706:x1874392815569152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787560548.152121:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6706:x1874392815569152:12345-0@lo:1000:mdt00_003.0 Request processed in 169us (236us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787560548.152139:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560548.152177:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6706:1874392815569152:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787560548.152247:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152258:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152266:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152273:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560548.152278:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152286:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152305:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d987d52b00) 00010000:00010000:1.0:1787560548.152308:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560548.152313:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152319:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f51f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152361:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152368:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f454 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152384:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152390:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560548.152393:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152400:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f454 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152409:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52400) 00010000:00010000:1.0:1787560548.152412:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560548.152414:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f454 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152419:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f454 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152444:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152458:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923a4 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152469:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152497:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923a4 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.152524:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923a4 expref: 16 pid: 5837 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560548.152538:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987384e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815569280:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560548.152600:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d991ca8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560548.172927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560548.172972:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788281856 00000100:00100000:3.0:1787560548.172984:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788281856 00010000:00010000:3.0:1787560548.173059:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923a4 expref: 17 pid: 5837 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560548.173102:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:3.0:1787560548.173114:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:2343:x1874392788281856:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560548.173132:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560548.173140:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923a4 expref: 17 pid: 5837 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.173156:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923a4 expref: 17 pid: 5837 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.173193:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52400) 00010000:00010000:3.0:1787560548.173200:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.173212:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.173221:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.173246:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560548.173321:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:2343:x1874392788281856:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 208us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560548.173328:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 46 00010000:00010000:2.0:1787560548.173537:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05673f470 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923a4 expref: 16 pid: 5837 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560548.173554:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987384e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815569280:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560548.173590:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173600:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173607:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173621:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173628:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173644:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173651:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560548.173656:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173664:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173675:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52400) 00010000:00010000:2.0:1787560548.173678:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560548.173683:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173690:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f526 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173702:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f518 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173709:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f518 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173715:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f518 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173721:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560548.173723:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f518 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173740:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f518 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173749:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987d52400) 00010000:00010000:2.0:1787560548.173751:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560548.173754:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f518 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.173761:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f518 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560548.174038:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:10434:x1874392788281600:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 37568us (37823us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787560548.174048:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 83 00000020:00080000:2.0:1787560548.174052:0:6706:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787560548.176425:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560548.176436:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560548.176471:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787560548.176480:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787560548.186720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560548.186813:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788282112 00000100:00100000:1.0:1787560548.186827:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788282112 00000100:00100000:1.0:1787560548.186926:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:1.0:1787560548.186939:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:10434:x1874392788282112:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787560548.187806:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787560548.187946:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787560548.188005:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.188024:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.188038:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.188048:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.188056:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.188063:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.188103:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560548.188225:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560548.188233:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560548.188245:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:10434:x1874392788282112:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 1305us (1537us total) trans 4294967362 rc 0/0 00010000:00010000:3.0:1787560548.188247:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560548.188252:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560548.188255:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00010000:00010000:3.0:1787560548.188260:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787560548.188262:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787560548.188276:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:3.0:1787560548.188279:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787560548.188284:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.188290:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f52d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.188309:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560548.188311:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560548.188313:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560548.494052:0:11998:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560548.494066:0:11998:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560548.494114:0:11998:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787560548.494121:0:11998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787560548.638782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.640067:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788282368 00000100:00100000:0.0:1787560548.640083:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788282368 00000100:00100000:0.0:1787560548.640155:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:0.0:1787560548.640165:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:10444:x1874392788282368:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560548.640201:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560548.640223:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f534 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923dc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.640506:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f53b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.640610:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f53b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.640625:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f53b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560548.640638:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787560548.640822:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f534 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923dc expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.640841:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f53b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923dc expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.641384:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:0.0:1787560548.641387:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787560548.641391:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980030600, rc 0) 00000100:00100000:0.0:1787560548.641688:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10444:x1874392788282368:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1522us (2915us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787560548.641696:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:2.0:1787560548.650979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560548.651014:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788282496 00000100:00100000:2.0:1787560548.651023:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788282496 00000100:00100000:2.0:1787560548.651071:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:2.0:1787560548.651080:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10444:x1874392788282496:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:2.0:1787560548.651148:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f549 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651163:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f549 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651185:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f549 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651213:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f550 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651221:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651228:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651480:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651488:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651495:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560548.651540:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651552:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f549 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651558:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f549 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651566:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f549 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651571:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560548.651575:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f549 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651588:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f549 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651600:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:2.0:1787560548.651603:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560548.651608:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f549 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651614:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f549 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651629:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651634:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f550 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651639:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651644:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560548.651646:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651652:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f550 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651659:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d987fffc00) 00010000:00010000:2.0:1787560548.651661:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560548.651664:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f550 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651678:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f550 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651692:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651698:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651703:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651707:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560548.651710:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651716:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651724:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fff300) 00010000:00010000:2.0:1787560548.651727:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560548.651729:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.651735:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560548.651808:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10444:x1874392788282496:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 727us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560548.651817:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:3.0:1787560548.702798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560548.703049:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788282752 00000100:00100000:2.0:1787560548.703059:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788282752 00000100:00100000:2.0:1787560548.703125:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:2.0:1787560548.703135:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10447:x1874392788282752:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560548.703154:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560548.703185:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f55e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923e3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.703263:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f565 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.703277:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.703288:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.703304:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f56c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.703311:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f56c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.703317:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f56c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.703824:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.703835:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.704515:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560548.704613:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787560548.704807:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f565 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704815:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f565 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704822:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f565 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704835:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560548.704840:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f565 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704866:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f565 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704880:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:3.0:1787560548.704882:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560548.704887:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f565 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704893:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f565 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704907:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f56c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704913:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f56c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704919:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f56c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704925:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560548.704927:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f56c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704932:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f56c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704949:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d987fff300) 00010000:00010000:3.0:1787560548.704951:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560548.704954:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f56c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.704959:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f56c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.705011:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f55e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923e3 expref: 22 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.705026:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923e3 expref: 21 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.705032:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:3.0:1787560548.705035:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560548.705037:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711600, rc 0) 00000100:00100000:3.0:1787560548.705109:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:10447:x1874392788282752:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1974us (2319us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787560548.705117:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:2.0:1787560548.709070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560548.709503:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788282880 00000100:00100000:3.0:1787560548.709515:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788282880 00000100:00100000:3.0:1787560548.709571:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00100000:3.0:1787560548.709581:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:10447:x1874392788282880:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:3.0:1787560548.709640:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f581 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.709656:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.709675:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.709710:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f581 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.709716:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f581 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.709722:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.709727:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebe00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560548.709732:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f581 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.709738:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f581 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.709749:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:3.0:1787560548.709752:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560548.709756:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f581 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.709761:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f581 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560548.709831:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:10447:x1874392788282880:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 250us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560548.709838:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00100000:3.0:1787560548.713543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.713735:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788283136 00000100:00100000:0.0:1787560548.713744:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788283136 00000100:00100000:0.0:1787560548.713803:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:0.0:1787560548.713814:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae747c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:10447:x1874392788283136:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560548.714123:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae747c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:10447:x1874392788283136:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 309us (597us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787560548.714131:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:3.0:1787560548.792576:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560548.792690:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788283392 00000100:00100000:2.0:1787560548.792706:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788283392 00000100:00100000:2.0:1787560548.792796:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 88 00000100:00100000:2.0:1787560548.792809:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:9975:x1874392788283392:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1787560548.793072:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560548.793096:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f588 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923ea expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.793209:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.793226:0:11858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923e3 expref: 23 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.793235:0:11858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.793336:0:11858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923e3 expref: 23 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.793366:0:11858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923e3 expref: 23 pid: 6706 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560548.793391:0:11858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815569408:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560548.793622:0:11858:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560548.796364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.797203:0:11858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815569408:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560548.797232:0:11858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560548.800416:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788283520 00000100:00100000:2.0:1787560548.800591:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788283520 00010000:00010000:2.0:1787560548.800645:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923e3 expref: 24 pid: 6706 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560548.800682:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:2.0:1787560548.800692:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:2342:x1874392788283520:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560548.800722:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560548.800730:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923e3 expref: 24 pid: 6706 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.800744:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923e3 expref: 24 pid: 6706 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.800765:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923e3 expref: 24 pid: 6706 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.800783:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:2.0:1787560548.800787:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.800795:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.800802:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.801203:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560548.801450:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:2342:x1874392788283520:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 756us (5092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560548.801459:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 47 00010000:00010000:3.0:1787560548.804254:0:11858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.804272:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560548.804295:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787560548.804771:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f588 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ea expref: 24 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.804799:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ea expref: 23 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.804811:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:3.0:1787560548.804814:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787560548.804817:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711a00, rc 0) 00000100:00100000:3.0:1787560548.804910:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:9975:x1874392788283392:12345-192.168.201.56@tcp:101:bash.0 Request processed in 12103us (12348us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787560548.804919:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 88 00000100:00100000:3.0:1787560548.807346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560548.807584:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788283776 00000100:00100000:1.0:1787560548.807595:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788283776 00000100:00100000:1.0:1787560548.807660:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 89 00000100:00100000:1.0:1787560548.807672:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:9975:x1874392788283776:12345-192.168.201.56@tcp:36:bash.0 00010000:00010000:1.0:1787560548.807987:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.808004:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.808015:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560548.808071:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787560548.808096:0:6706:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e48339a reply state 00000000cd717c1f transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560548.808105:0:6706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787560548.808161:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787560548.808270:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:9975:x1874392788283776:12345-192.168.201.56@tcp:36:bash.0 Request processed in 600us (932us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787560548.808277:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 89 00000020:00080000:1.0:1787560548.808281:0:6706:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787560548.810145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560548.810270:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788283904 00000100:00100000:2.0:1787560548.810279:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788283904 00000100:00100000:2.0:1787560548.810333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00100000:2.0:1787560548.810343:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:9975:x1874392788283904:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1787560548.810391:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560548.810410:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f5a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.810477:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f5a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f1 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.810492:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f5a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f1 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560548.810512:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:2.0:1787560548.810515:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560548.810519:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711e00, rc 0) 00000100:00100000:2.0:1787560548.810568:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+28:9975:x1874392788283904:12345-192.168.201.56@tcp:101:bash.0 Request processed in 226us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560548.810575:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 90 00010000:00010000:1.0:1787560548.811271:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.811282:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.811288:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.811294:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560548.811298:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.811306:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.811318:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:1.0:1787560548.811321:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560548.811324:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.811330:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f59d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560548.814731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.820492:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788284032 00000100:00100000:0.0:1787560548.820509:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788284032 00000100:00100000:0.0:1787560548.820590:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:0.0:1787560548.820601:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:9975:x1874392788284032:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560548.820618:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560548.820639:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a109359/0xe34191b05673f5ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923f8 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560548.820667:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c0263, atime: 0x6a8c0261, ctime: 0x6a8c0263, blocks: 0xb 00010000:00010000:0.0:1787560548.820690:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787560548.820696:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560548.820704:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a109359/0xe34191b05673f5ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f8 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.820721:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a109359/0xe34191b05673f5ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f8 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.820755:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d980031800, rc 0) 00000100:00100000:0.0:1787560548.820828:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:9975:x1874392788284032:12345-192.168.201.56@tcp:101:bash.0 Request processed in 228us (6107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560548.820835:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:1.0:1787560548.825696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560548.825801:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788284160 00000100:00100000:2.0:1787560548.825814:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788284160 00002000:00010000:2.0:1787560548.825893:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787560548.825898:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d987385c00 with x1874392788284160 ext(0->18446744073709551615) 00002000:00010000:2.0:1787560548.825910:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d987385c00. 00000100:00100000:2.0:1787560548.825934:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:2.0:1787560548.825944:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788284160:12345-192.168.201.56@tcp:10:bash.0 00002000:00010000:2.0:1787560548.826239:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787560548.826243:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787560547 -> 1787560549 00002000:00010000:2.0:1787560548.826245:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787560545 -> 1787560545 00002000:00010000:2.0:1787560548.826261:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787560547 -> 1787560549 00002000:00010000:2.0:1787560548.826263:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787560548.826330:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2342:x1874392788284160:12345-192.168.201.56@tcp:10:bash.0 Request processed in 387us (644us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787560548.826338:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1 00002000:00010000:2.0:1787560548.826341:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787560548.826344:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d987385c00 with x1874392788284160 ext(0->18446744073709551615) 00002000:00010000:2.0:1787560548.826349:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d987385c00. 00000100:00100000:3.0:1787560548.948614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.949135:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788284288 00000100:00100000:0.0:1787560548.949145:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788284288 00000100:00100000:0.0:1787560548.949235:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 91 00000100:00100000:0.0:1787560548.949245:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10461:x1874392788284288:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:0.0:1787560548.949311:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f5b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.949327:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f5b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.949338:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f5b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.949372:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.949379:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.949387:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950225:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950250:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950258:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560548.950304:0:11858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950315:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f5b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950322:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f5b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950329:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f5b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950335:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560548.950339:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f5b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950346:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f5b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950357:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:0.0:1787560548.950360:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560548.950364:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f5b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950370:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030c00/0xe34191b05673f5b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950392:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950398:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950404:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950409:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560548.950412:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950579:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950590:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d987fb3f00) 00010000:00010000:0.0:1787560548.950593:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560548.950596:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950601:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950615:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950620:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950625:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950638:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560548.950641:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950647:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950655:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:0.0:1787560548.950658:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560548.950661:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.950667:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560548.951034:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10461:x1874392788284288:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 1786us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560548.951043:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 91 00000100:00100000:3.0:1787560548.983472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.983594:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788284544 00000100:00100000:0.0:1787560548.983610:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788284544 00000100:00100000:0.0:1787560548.983692:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:0.0:1787560548.983715:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:10464:x1874392788284544:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560548.983737:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560548.983769:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf923ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.983896:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.983929:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.983940:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.983957:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f5d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.983965:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.983971:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984319:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f5dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984328:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984335:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560548.984345:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787560548.984440:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984448:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984454:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984466:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560548.984472:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984479:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984492:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:0.0:1787560548.984495:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560548.984499:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984512:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f5ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984526:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f5d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984532:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f5d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984538:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f5d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984543:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560548.984546:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f5d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984551:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f5d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984569:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d987fb3f00) 00010000:00010000:0.0:1787560548.984571:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560548.984574:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f5d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984580:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f5d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984621:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673f5c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ff expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984635:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f5dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ff expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560548.984643:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:0.0:1787560548.984645:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787560548.984647:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101e00, rc 0) 00000100:00100000:0.0:1787560548.984723:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:10464:x1874392788284544:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1010us (1265us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787560548.984731:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:1.0:1787560548.988906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560548.989006:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788284672 00000100:00100000:3.0:1787560548.989024:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788284672 00000100:00100000:3.0:1787560548.989106:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00100000:3.0:1787560548.989140:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:10464:x1874392788284672:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:3.0:1787560548.989245:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.989275:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ea expref: 29 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.989286:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.989332:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ea expref: 29 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.989350:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ea expref: 29 pid: 11858 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560548.989368:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815569536:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560548.989755:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9887cae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560548.992768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560548.992922:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788284928 00000100:00100000:0.0:1787560548.992937:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788284928 00000100:00100000:1.0:1787560548.992957:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815569536:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560548.992995:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560548.993018:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:0.0:1787560548.993036:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:9221:x1874392788284928:12345-192.168.201.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787560548.993397:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:9221:x1874392788284928:12345-192.168.201.56@tcp:35:ldlm_bl.0 Request processed in 366us (641us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787560548.993405:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:2.0:1787560548.995655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560548.995775:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788285056 00000100:00100000:3.0:1787560548.995785:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788285056 00010000:00010000:3.0:1787560548.995837:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ea expref: 31 pid: 11858 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560548.995901:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:3.0:1787560548.995921:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:2342:x1874392788285056:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560548.995935:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560548.995954:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ea expref: 31 pid: 11858 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.995968:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ea expref: 31 pid: 11858 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.995990:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f58f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ea expref: 31 pid: 11858 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.996004:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:3.0:1787560548.996010:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.996020:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.996028:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560548.996058:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560548.996130:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.996248:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560548.996317:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:2342:x1874392788285056:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 397us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560548.996331:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 48 00010000:00010000:1.0:1787560548.996556:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.996567:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.996576:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.996583:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebe00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560548.996589:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.996599:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.996616:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:1.0:1787560548.996620:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560548.996625:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560548.996632:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673f5ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560548.996721:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:10464:x1874392788284672:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 7583us (7820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560548.996732:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00100000:1.0:1787560549.001407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560549.001548:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788285312 00000100:00100000:0.0:1787560549.001557:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788285312 00000100:00100000:0.0:1787560549.001611:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:0.0:1787560549.001621:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:10464:x1874392788285312:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560549.001878:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:10464:x1874392788285312:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 258us (481us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787560549.001886:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:0.0:1787560549.082789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560549.082878:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788285568 00000100:00100000:3.0:1787560549.082889:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788285568 00000100:00100000:3.0:1787560549.082948:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:3.0:1787560549.082956:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:10475:x1874392788285568:12345-192.168.201.56@tcp:101:cat.0 00010000:00010000:3.0:1787560549.082986:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560549.083015:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f5f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92406 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083131:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f5f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083148:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f5f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083161:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f5f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083188:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f5ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083196:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083203:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083653:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673f606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083664:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673f606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083673:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673f606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560549.083683:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787560549.083781:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f5f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083794:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f5f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083799:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f5f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083803:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eae00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560549.083808:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f5f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083813:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f5f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083825:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:3.0:1787560549.083827:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560549.083830:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f5f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083834:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f5f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083888:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f5ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083893:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f5ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083897:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083900:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560549.083907:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f5ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083911:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f5ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083916:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d9a1269500) 00010000:00010000:3.0:1787560549.083917:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560549.083919:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f5ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083923:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f5ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083964:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f5f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92406 expref: 33 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083976:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673f606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92406 expref: 32 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.083984:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:3.0:1787560549.083986:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560549.083989:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea600, rc 0) 00000100:00100000:3.0:1787560549.084196:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:10475:x1874392788285568:12345-192.168.201.56@tcp:101:cat.0 Request processed in 1238us (1416us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787560549.084206:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:3.0:1787560549.088014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560549.088182:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788285824 00000100:00100000:0.0:1787560549.088196:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788285824 00000100:00100000:0.0:1787560549.088271:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:0.0:1787560549.088284:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:10475:x1874392788285824:12345-192.168.201.56@tcp:35:cat.0 00000100:00100000:0.0:1787560549.088645:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+33:10475:x1874392788285824:12345-192.168.201.56@tcp:35:cat.0 Request processed in 362us (646us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787560549.088653:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:1.0:1787560549.120542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560549.126427:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788286080 00000100:00100000:2.0:1787560549.126450:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788286080 00000100:00100000:2.0:1787560549.126632:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 95 00000100:00100000:2.0:1787560549.126645:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+33:10476:x1874392788286080:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:2.0:1787560549.126726:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787560549.126762:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673f606 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92406 expref: 33 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.126797:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f5dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923ff expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.126811:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f5a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f1 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.126823:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fffc00) 00010000:00010000:2.0:1787560549.126836:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560549.126900:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f614 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.126943:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f614 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.126954:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f614 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.126970:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.126988:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.126995:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.127390:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f622 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.127399:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f622 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.127407:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f622 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560549.128158:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787560549.128181:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377881332931ns, next at 378881329254ns, rc = 0 00010000:00010000:2.0:1787560549.128252:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128264:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128284:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128293:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128300:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128307:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128334:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787560549.128361:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f622 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128367:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f622 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128373:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f622 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128379:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560549.128386:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f622 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128394:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f622 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128406:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fff100) 00010000:00010000:2.0:1787560549.128410:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787560549.128421:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f622 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128427:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f622 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128448:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f614 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128454:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f614 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128460:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f614 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128464:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560549.128467:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f614 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128473:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f614 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128480:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:2.0:1787560549.128483:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560549.128486:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f614 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.128492:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f614 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560549.128508:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a134550 reply state 0000000056580a97 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560549.128530:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560549.128651:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:10476:x1874392788286080:12345-192.168.201.56@tcp:36:rm.0 Request processed in 2003us (8121us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787560549.128660:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 95 00010000:00010000:3.0:1787560549.132195:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560549.132214:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.132269:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711a00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560549.132275:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.132285:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.132310:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff93d987fff100) 00010000:00010000:3.0:1787560549.132313:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787560549.132320:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.132325:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f629 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.132361:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560549.132363:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560549.132365:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560549.135385:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.135408:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.135416:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.135422:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560549.135429:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.135461:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.135483:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d987ffff00) 00010000:00010000:0.0:1787560549.135487:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560549.135492:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.135508:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673f61b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.136819:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560549.195611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560549.199608:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788286336 00000100:00100000:3.0:1787560549.199631:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788286336 00000100:00100000:3.0:1787560549.199761:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 96 00000100:00100000:3.0:1787560549.199776:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:10482:x1874392788286336:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1787560549.199808:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560549.199837:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673f630 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9240d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.200048:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f637 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.200066:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f637 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.200098:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f637 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.200117:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.200125:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.200131:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787560549.200906:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787560549.201129:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201141:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201152:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201205:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f637 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201214:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f637 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201221:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f637 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201228:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560549.201240:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f637 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201249:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f637 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201263:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:3.0:1787560549.201267:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560549.201271:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f637 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201278:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f637 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560549.201299:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d88db7b reply state 00000000d7495c2b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.201309:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787560549.201348:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673f630 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9240d expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201362:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9240d expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.201370:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:3.0:1787560549.201372:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560549.201375:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eae00, rc 0) 00000100:00100000:3.0:1787560549.201471:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:10482:x1874392788286336:12345-192.168.201.56@tcp:101:bash.0 Request processed in 1698us (5876us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787560549.201481:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 96 00000100:00100000:1.0:1787560549.208986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:2.0:1787560549.209283:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.209299:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.209307:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.209313:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560549.209319:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.209327:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.209349:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d9a1269500) 00010000:00010000:2.0:1787560549.209352:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560549.209357:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.209364:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673f63e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.209713:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788286464 00000100:00100000:3.0:1787560549.209727:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788286464 00000100:00100000:3.0:1787560549.209808:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:3.0:1787560549.209819:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98a67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788286464:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1787560549.209840:0:8101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560549.209884:0:8101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b05673f653 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92414 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560549.209915:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560549.209939:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1787560549.209945:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560549.209957:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b05673f653 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92414 expref: 8 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.209978:0:8101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b05673f653 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92414 expref: 8 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.209992:0:8101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb600, rc 0) 00000100:00080000:2.0:1787560549.210076:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560549.210209:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98a67e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2342:x1874392788286464:12345-192.168.201.56@tcp:101:bash.0 Request processed in 391us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560549.210218:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:1.0:1787560549.217089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560549.217270:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788286592 00000100:00100000:0.0:1787560549.217284:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788286592 00000100:00100000:0.0:1787560549.217360:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:0.0:1787560549.217373:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:10482:x1874392788286592:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560549.217396:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560549.217420:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9241b expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.217701:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b05673f653 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92414 expref: 9 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.217711:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560549.217717:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560549.217723:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.217791:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b05673f653 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92414 expref: 9 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.217807:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b05673f653 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92414 expref: 9 pid: 8101 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560549.217825:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3952300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1874392815569664:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560549.223828:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560549.226139:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3952300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1874392815569664:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560549.226197:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.226226:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101c00, rc 0) 00000100:00100000:1.0:1787560549.226310:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:10482:x1874392788286592:12345-192.168.201.56@tcp:101:bash.0 Request processed in 8939us (9237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560549.226320:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:3.0:1787560549.232710:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560549.232841:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788286720 00000100:00100000:0.0:1787560549.232898:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788286720 00010000:00010000:0.0:1787560549.232958:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b05673f653 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92414 expref: 9 pid: 8101 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560549.233021:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:0.0:1787560549.233034:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e12850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2345:x1874392788286720:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560549.233053:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560549.233084:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b05673f653 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92414 expref: 9 pid: 8101 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.233101:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b05673f653 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92414 expref: 9 pid: 8101 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.233130:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b05673f653 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92414 expref: 9 pid: 8101 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.233189:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560549.233195:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560549.233206:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.233218:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.233282:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560549.233298:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3952a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1874392815569792:192.168.201.56@tcp:105: 00000100:00100000:0.0:1787560549.233399:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560549.242749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560549.242889:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3952a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1874392815569792:192.168.201.56@tcp:105: 00010000:00010000:2.0:1787560549.242941:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560549.243035:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e12850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2345:x1874392788286720:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 10002us (10342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560549.243049:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:3.0:1787560549.243265:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788286976 00000100:00100000:3.0:1787560549.243275:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788286976 00000100:00100000:3.0:1787560549.243337:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:3.0:1787560549.243348:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+33:10482:x1874392788286976:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:3.0:1787560549.243789:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:10482:x1874392788286976:12345-192.168.201.56@tcp:35:bash.0 Request processed in 440us (1053us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787560549.243797:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:1.0:1787560549.389181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560549.389442:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788287104 00000100:00100000:0.0:1787560549.389456:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788287104 00000100:00100000:0.0:1787560549.389538:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00100000:0.0:1787560549.389551:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:10498:x1874392788287104:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560549.389585:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560549.389612:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92422 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.389702:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673f668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.389720:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673f668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.389754:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673f668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560549.389994:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787560549.389998:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560549.390032:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673f668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.390067:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92422 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.390092:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673f668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92422 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.390102:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:0.0:1787560549.390105:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560549.390111:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100e00, rc 0) 00000100:00100000:0.0:1787560549.390332:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+35:10498:x1874392788287104:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 782us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560549.390341:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00100000:1.0:1787560549.394733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560549.394829:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788287360 00000100:00100000:2.0:1787560549.394841:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788287360 00000100:00100000:2.0:1787560549.394926:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:2.0:1787560549.394940:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+35:10498:x1874392788287360:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560549.394967:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560549.395001:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f66f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92429 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.395141:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.395157:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.395180:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560549.395194:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787560549.395588:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f66f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92429 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.395605:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92429 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.395611:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:2.0:1787560549.395631:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560549.395634:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711e00, rc 0) 00000100:00100000:2.0:1787560549.395741:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:10498:x1874392788287360:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 805us (1025us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787560549.395748:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:3.0:1787560549.398763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560549.398901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560549.398983:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788287744 00000100:00100000:1.0:1787560549.398993:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788287744 00000100:00100000:1.0:1787560549.399075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:1.0:1787560549.399087:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:10498:x1874392788287744:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560549.399120:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560549.399149:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f684 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92430 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560549.399360:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788287488 00000100:00100000:2.0:1787560549.399365:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788287488 00010000:00010000:1.0:1787560549.399374:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f68b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.399413:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f68b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560549.399419:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:2.0:1787560549.399427:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+39:2343:x1874392788287488:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560549.399438:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560549.399548:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f68b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.399559:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f676 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92429 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560549.399562:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787560549.399577:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:2.0:1787560549.399583:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560549.399656:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+39:2343:x1874392788287488:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 230us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560549.399664:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00010000:00010000:1.0:1787560549.399715:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f684 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92430 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.399726:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f68b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92430 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.399732:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:1.0:1787560549.399734:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787560549.399736:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261400, rc 0) 00000100:00100000:1.0:1787560549.399755:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+38:10498:x1874392788287744:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 674us (855us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787560549.399759:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:1.0:1787560549.404185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560549.404582:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788287872 00000100:00100000:3.0:1787560549.404596:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788287872 00000100:00100000:3.0:1787560549.404705:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:3.0:1787560549.404718:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2344:x1874392788287872:12345-192.168.201.56@tcp:1:lfs.0 00010000:00010000:3.0:1787560549.404777:0:8101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.404802:0:8101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.404813:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787560549.404818:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560549.404823:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.404895:0:8101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.404912:0:8101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 8 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.404954:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8101:1874392815569920:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560549.405101:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9887cae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560549.408306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560549.408408:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788288000 00000100:00100000:2.0:1787560549.408432:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788288000 00002000:00100000:2.0:1787560549.408499:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93d9b3951f80 x1874392788288000/t0(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:665/0 lens 504/0 e 0 to 0 dl 1787560560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560549.408513:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9b3951f80 with x1874392788288000 ext(0->8) 00010000:00010000:2.0:1787560549.408524:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 9 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.408543:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 9 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560549.408569:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93d9b3951f80 00000100:00100000:2.0:1787560549.408606:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:2.0:1787560549.408617:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2342:x1874392788288000:12345-192.168.201.56@tcp:4:lfs.0 00000100:00100000:2.0:1787560549.410364:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:2342:x1874392788288000:12345-192.168.201.56@tcp:4:lfs.0 Request processed in 1733us (2057us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787560549.410378:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1 00002000:00100000:2.0:1787560549.410391:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff93d9b3951f80 x1874392788288000/t4294967302(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:665/0 lens 504/448 e 0 to 0 dl 1787560560 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560549.410401:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9b3951f80 with x1874392788288000 ext(0->8) 00010000:00010000:2.0:1787560549.410411:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 11 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.410541:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8101:1874392815569920:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560549.410567:0:8101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.411714:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 11 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560549.411727:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93d9b3951f80 00000100:00100000:0.0:1787560549.413993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560549.414174:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788288128 00000100:00100000:2.0:1787560549.414186:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788288128 00010000:00010000:2.0:1787560549.414240:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 11 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560549.414327:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:2.0:1787560549.414341:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:2345:x1874392788288128:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560549.414385:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787560549.414410:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787560549.414414:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787560549 00002000:00010000:2.0:1787560549.414416:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787560549 00002000:00010000:2.0:1787560549.414418:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787560549 00010000:00010000:2.0:1787560549.414435:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 11 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.414451:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 11 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.414488:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673f65a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9241b expref: 11 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.414509:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560549.414514:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560549.414521:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.414531:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.414565:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560549.414629:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:2345:x1874392788288128:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 292us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560549.414635:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 50 00010000:00010000:3.0:1787560549.415181:0:8101:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.415194:0:8101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.415226:0:8101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.415234:0:8101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.415243:0:8101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.415251:0:8101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eac00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560549.415255:0:8101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.415279:0:8101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.415295:0:8101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.415304:0:8101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096116442/0xe34191b05673f699 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.415388:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2344:x1874392788287872:12345-192.168.201.56@tcp:1:lfs.0 Request processed in 10672us (11392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560549.415398:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:0.0:1787560549.417236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560549.417399:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788288384 00000100:00100000:3.0:1787560549.417411:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788288384 00000100:00100000:3.0:1787560549.417542:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:3.0:1787560549.417551:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae746c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+38:10498:x1874392788288384:12345-192.168.201.56@tcp:35:lfs.0 00000004:00010000:3.0:1787560549.417623:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f68b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92430 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560549.417973:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787560549.418017:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787560549.418414:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787560549.418613:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.418627:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9240d expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.418643:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.418681:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9240d expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.418694:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9240d expref: 42 pid: 5837 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.418707:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874392815570048:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560549.418866:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9887cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560549.421659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560549.421822:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788288512 00000100:00100000:0.0:1787560549.421835:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788288512 00010000:00010000:0.0:1787560549.421937:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9240d expref: 43 pid: 5837 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.422017:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1874392815570048:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560549.422017:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:0.0:1787560549.422027:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+43:2343:x1874392788288512:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560549.422046:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.422046:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560549.422053:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9240d expref: 43 pid: 5837 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.422067:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9240d expref: 43 pid: 5837 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.422094:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673f645 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9240d expref: 43 pid: 5837 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.422114:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:0.0:1787560549.422119:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.422129:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.422137:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.422173:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560549.422219:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.422227:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560549.422278:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+42:2343:x1874392788288512:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 253us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560549.422286:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 51 00000001:00080000:3.0:1787560549.422398:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787560549.422659:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787560549.422784:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874392815570176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787560549.422842:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560549.422898:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98519ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560549.422915:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815570176 00000100:00100000:0.0:1787560549.422931:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815570176 00000100:00100000:0.0:1787560549.422989:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560549.422998:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1874392815570176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787560549.423077:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1874392815570176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560549.423084:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787560549.423274:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560549.423662:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874392815570176:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787560549.424240:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787560549.424330:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874392815570304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787560549.424397:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560549.424443:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9887cae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560549.424504:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815570304 00000100:00100000:0.0:1787560549.424512:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815570304 00000100:00100000:0.0:1787560549.424567:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560549.424586:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1874392815570304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787560549.424802:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5840:x1874392815570304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 225us (404us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787560549.424810:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560549.425037:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1874392815570304:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787560549.425088:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1787560549.425132:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.425141:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.425148:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.425152:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560549.425156:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.425173:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.425199:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:2.0:1787560549.425203:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787560549.425209:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.425216:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673f6a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560549.426235:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787560549.426400:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1787560549.426415:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378179567125ns, next at 379179564135ns, rc = 0 00000001:00080000:2.0:1787560549.426426:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1787560549.426500:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:2.0:1787560549.426504:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787560549.426517:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673f68b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92430 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560549.427560:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae746c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+45:10498:x1874392788288384:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 10002us (10327us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1787560549.427575:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 26 00000020:00080000:2.0:1787560549.427584:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787560549.435398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560549.435733:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788288640 00000100:00100000:0.0:1787560549.435748:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788288640 00000100:00100000:0.0:1787560549.435833:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00100000:0.0:1787560549.435889:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+45:10498:x1874392788288640:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560549.435925:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560549.435957:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673f6a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92437 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.436043:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673f6a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92437 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.436060:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673f6a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92437 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.436121:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:0.0:1787560549.436124:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560549.436129:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100400, rc 0) 00000100:00100000:0.0:1787560549.436214:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+46:10498:x1874392788288640:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 371us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560549.436222:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00100000:0.0:1787560549.454503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560549.454647:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788288896 00000100:00100000:2.0:1787560549.454660:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788288896 00000100:00100000:2.0:1787560549.454732:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:2.0:1787560549.454748:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+46:10498:x1874392788288896:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:2.0:1787560549.455113:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+47:10498:x1874392788288896:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 367us (625us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787560549.455122:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:1.0:1787560549.587816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560549.587985:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788289024 00000100:00100000:2.0:1787560549.588000:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788289024 00000100:00100000:2.0:1787560549.588079:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 101 00000100:00100000:2.0:1787560549.588091:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+47:10508:x1874392788289024:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:2.0:1787560549.588242:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f6ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588485:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f6ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588502:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f6ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588546:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f6b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588556:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588563:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588704:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588714:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588722:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560549.588775:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588790:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f6ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588796:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f6ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588804:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f6ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588811:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560549.588816:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f6ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588830:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f6ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588844:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:2.0:1787560549.588881:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560549.588887:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f6ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588893:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f6ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588908:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588914:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f6b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588921:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588926:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560549.588929:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588936:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f6b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588943:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d987fffc00) 00010000:00010000:2.0:1787560549.588946:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560549.588948:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f6b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588967:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f6b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588985:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588991:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.588997:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.589002:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560549.589005:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.589011:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.589020:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:2.0:1787560549.589022:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560549.589025:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.589032:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f6bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560549.590820:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+47:10508:x1874392788289024:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 2715us (3004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560549.590838:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 101 00000100:00100000:1.0:1787560549.670990:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560549.671207:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788289280 00000100:00100000:3.0:1787560549.671221:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788289280 00000100:00100000:3.0:1787560549.671312:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 102 00000100:00100000:3.0:1787560549.671324:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+47:10511:x1874392788289280:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560549.671351:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560549.671378:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673f6c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9243e expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671491:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f6ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671509:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f6ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671521:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f6ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671537:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f6d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671545:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671551:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671746:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671755:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671762:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560549.671774:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787560549.671956:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f6ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671965:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f6ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671973:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f6ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671979:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560549.671985:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f6ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.671993:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f6ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.672007:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:3.0:1787560549.672010:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560549.672015:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f6ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.672033:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f6ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.672056:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.672063:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f6d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.672069:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.672074:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560549.672077:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.672083:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f6d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.672090:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d9a1269e00) 00010000:00010000:3.0:1787560549.672093:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560549.672096:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f6d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.672102:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f6d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.672238:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673f6c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9243e expref: 50 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.672260:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9243e expref: 49 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.672269:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:2.0:1787560549.672272:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560549.672276:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb000, rc 0) 00000100:00100000:2.0:1787560549.672364:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+49:10511:x1874392788289280:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1041us (1389us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787560549.672373:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 102 00000100:00100000:0.0:1787560549.675992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560549.676073:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788289408 00000100:00100000:3.0:1787560549.676086:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788289408 00000100:00100000:3.0:1787560549.676176:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 103 00000100:00100000:3.0:1787560549.676188:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+49:10511:x1874392788289408:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:3.0:1787560549.676316:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f6e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.676340:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.676354:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.676385:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.676392:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f6e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.676399:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.676406:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560549.676411:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.676431:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f6e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.676446:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:3.0:1787560549.676450:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560549.676463:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f6e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.676470:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f6e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.676579:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+49:10511:x1874392788289408:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 393us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560549.676587:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 103 00000100:00100000:1.0:1787560549.681302:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560549.685184:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788289664 00000100:00100000:2.0:1787560549.685206:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788289664 00000100:00100000:2.0:1787560549.685301:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:2.0:1787560549.685316:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+49:10511:x1874392788289664:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:2.0:1787560549.685666:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+50:10511:x1874392788289664:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 352us (4377us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787560549.685675:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:2.0:1787560549.783711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560549.788057:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788289920 00000100:00100000:0.0:1787560549.788080:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788289920 00000100:00100000:1.0:1787560549.791891:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:1.0:1787560549.791913:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+50:10520:x1874392788289920:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1787560549.791980:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560549.791984:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787560549.792023:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673f668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92422 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.792049:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:1.0:1787560549.792056:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560549.792074:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f6ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92445 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.792241:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.792257:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9243e expref: 50 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.792267:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.792322:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9243e expref: 50 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.792339:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9243e expref: 50 pid: 6706 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560549.792357:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874392815570432:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560549.792510:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9884e1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560549.803968:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874392815570432:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560549.804039:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560549.806298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560549.807018:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788290048 00000100:00100000:0.0:1787560549.807033:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788290048 00010000:00010000:0.0:1787560549.807173:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9243e expref: 51 pid: 6706 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560549.807228:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:0.0:1787560549.807242:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+51:2342:x1874392788290048:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560549.807262:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560549.807270:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9243e expref: 51 pid: 6706 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.807287:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9243e expref: 51 pid: 6706 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.807314:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673f6d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9243e expref: 51 pid: 6706 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.807365:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:0.0:1787560549.807372:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.807382:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.807390:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.808876:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560549.808977:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+50:2342:x1874392788290048:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 1731us (2694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560549.808992:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 52 00010000:00010000:1.0:1787560549.811731:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.811755:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560549.811787:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787560549.812267:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f6ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92445 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.812295:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92445 expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.812305:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:1.0:1787560549.812309:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560549.812312:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260000, rc 0) 00000100:00100000:1.0:1787560549.812405:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+50:10520:x1874392788289920:12345-192.168.201.56@tcp:101:bash.0 Request processed in 20497us (28709us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787560549.812421:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:2.0:1787560549.815691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560549.815839:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788290304 00000100:00100000:1.0:1787560549.815873:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788290304 00000100:00100000:1.0:1787560549.815959:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 105 00000100:00100000:1.0:1787560549.815973:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+50:10520:x1874392788290304:12345-192.168.201.56@tcp:36:bash.0 00010000:00010000:1.0:1787560549.816425:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.816482:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.816498:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560549.816783:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787560549.816819:0:6706:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c05a9bef reply state 000000003e5f62ea transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560549.816831:0:6706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560549.817012:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+53:10520:x1874392788290304:12345-192.168.201.56@tcp:36:bash.0 Request processed in 1041us (1334us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787560549.817020:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 105 00000020:00080000:1.0:1787560549.817027:0:6706:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787560549.820705:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.820729:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.820737:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.820744:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560549.820750:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.820758:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.820779:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:3.0:1787560549.820783:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560549.820789:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.820796:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f702 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560549.822530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560549.828313:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788290432 00000100:00100000:1.0:1787560549.828335:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788290432 00000100:00100000:3.0:1787560549.829047:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 106 00000100:00100000:3.0:1787560549.829063:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:10520:x1874392788290432:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1787560549.829130:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560549.829171:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f709 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9244c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.829281:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.829299:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92445 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.829309:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.829359:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92445 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.829374:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92445 expref: 53 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.829391:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab96300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815570560:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560549.829531:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9887ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560549.834925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560549.834998:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788290560 00000100:00100000:1.0:1787560549.835012:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788290560 00010000:00010000:1.0:1787560549.835073:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92445 expref: 54 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560549.835126:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:1.0:1787560549.835139:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:2343:x1874392788290560:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560549.835169:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560549.835178:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92445 expref: 54 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.835194:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92445 expref: 54 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.835241:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:1.0:1787560549.835247:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.835258:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.835266:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.835419:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560549.835496:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:2343:x1874392788290560:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 358us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560549.835506:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 53 00010000:00010000:3.0:1787560549.835739:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f6f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92445 expref: 53 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.835762:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab96300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815570560:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560549.835788:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.835813:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.835819:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560549.836438:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787560549.836447:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560549.836479:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.836523:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f709 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9244c expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.836550:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9244c expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560549.836561:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:3.0:1787560549.836564:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560549.836568:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eba00, rc 0) 00000100:00100000:3.0:1787560549.836644:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:10520:x1874392788290432:12345-192.168.201.56@tcp:101:bash.0 Request processed in 7583us (14125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560549.836652:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 106 00000100:00100000:0.0:1787560549.841837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560549.842201:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788290816 00000100:00100000:3.0:1787560549.842213:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788290816 00000100:00100000:3.0:1787560549.842277:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:3.0:1787560549.842531:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:10520:x1874392788290816:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:3.0:1787560549.842835:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+53:10520:x1874392788290816:12345-192.168.201.56@tcp:35:bash.0 Request processed in 312us (1011us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787560549.842878:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:1.0:1787560549.935045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560549.935256:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788290944 00000100:00100000:2.0:1787560549.935271:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788290944 00000100:00100000:2.0:1787560549.935364:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 107 00000100:00100000:2.0:1787560549.935377:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+53:10527:x1874392788290944:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560549.935437:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560549.935685:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92453 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.935776:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f71e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.935793:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f71e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.935805:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f71e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560549.935935:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787560549.935940:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560549.935969:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f71e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.936203:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92453 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.936230:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f71e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92453 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.936240:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:2.0:1787560549.936243:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560549.936248:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710600, rc 0) 00000100:00100000:2.0:1787560549.936322:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:10527:x1874392788290944:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 948us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560549.936637:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 107 00000100:00100000:0.0:1787560549.940030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560549.940285:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788291072 00000100:00100000:1.0:1787560549.940309:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788291072 00000100:00100000:1.0:1787560549.940641:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 108 00000100:00100000:1.0:1787560549.940655:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:10527:x1874392788291072:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560549.940682:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560549.940709:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f725 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9245a expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.940791:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f72c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.940809:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f72c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.940841:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f72c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.941703:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.941714:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.941723:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942693:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f73a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942708:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942719:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560549.942772:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787560549.942778:0:6706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560549.942799:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942812:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942821:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f72c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942869:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f72c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942877:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f72c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942882:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560549.942887:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f72c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942895:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f72c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942910:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:1.0:1787560549.942913:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560549.942917:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f72c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942924:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f72c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942941:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942947:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f733 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942952:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942957:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560549.942966:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942972:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f733 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942980:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d995c27e00) 00010000:00010000:1.0:1787560549.942982:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560549.942985:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f733 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.942991:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.943039:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f725 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9245a expref: 56 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.943055:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f73a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9245a expref: 55 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.943063:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:1.0:1787560549.943066:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560549.943068:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261e00, rc 0) 00000100:00100000:1.0:1787560549.943189:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:10527:x1874392788291072:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 2536us (3190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560549.943198:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 108 00000100:00100000:0.0:1787560549.952633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560549.952788:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788291200 00000100:00100000:1.0:1787560549.952802:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788291200 00000100:00100000:1.0:1787560549.952908:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:1.0:1787560549.952923:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:2343:x1874392788291200:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560549.952960:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560549.952990:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f73a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9245a expref: 55 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.953023:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:1.0:1787560549.953028:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560549.953095:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:2343:x1874392788291200:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 176us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560549.953103:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:3.0:1787560549.955233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560549.955598:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788291456 00000100:00100000:0.0:1787560549.955611:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788291456 00000100:00100000:0.0:1787560549.955680:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 109 00000100:00100000:0.0:1787560549.955693:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:10527:x1874392788291456:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560549.955721:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560549.955747:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f741 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92461 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.955931:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.955965:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9244c expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.955975:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.956032:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9244c expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.956049:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9244c expref: 55 pid: 5837 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560549.956066:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815570688:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560549.956194:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27180 going to sleep for 11 seconds 00000100:00100000:0.0:1787560549.963032:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815570688:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560549.963076:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560549.965335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560549.967432:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788291584 00000100:00100000:1.0:1787560549.967460:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788291584 00010000:00010000:1.0:1787560549.967533:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9244c expref: 56 pid: 5837 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560549.967592:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:1.0:1787560549.967604:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e12050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:2343:x1874392788291584:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560549.967625:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560549.967633:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9244c expref: 56 pid: 5837 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.967648:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9244c expref: 56 pid: 5837 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.967675:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673f710 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9244c expref: 56 pid: 5837 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.967702:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:1.0:1787560549.967726:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.967738:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.967746:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.967773:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560549.967895:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e12050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:2343:x1874392788291584:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 292us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560549.967904:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 54 00010000:00010000:0.0:1787560549.969060:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.969075:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560549.969103:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787560549.969333:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f741 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92461 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.969374:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92461 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560549.969397:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:0.0:1787560549.969401:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787560549.969405:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101000, rc 0) 00000100:00100000:0.0:1787560549.969476:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:10527:x1874392788291456:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 13785us (14254us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787560549.969486:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 109 00000100:00100000:3.0:1787560549.976698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560549.987166:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788291840 00000100:00100000:1.0:1787560549.987190:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788291840 00000100:00100000:1.0:1787560549.987867:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:1.0:1787560549.987886:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:10527:x1874392788291840:12345-192.168.201.56@tcp:103:lfs.0 00010000:00010000:1.0:1787560549.987909:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560549.988505:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673f6a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92437 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560549.988536:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:1.0:1787560549.988542:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560549.988714:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:10527:x1874392788291840:12345-192.168.201.56@tcp:103:lfs.0 Request processed in 834us (12029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560549.988723:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:3.0:1787560549.991457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560549.991980:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788291968 00000100:00100000:2.0:1787560549.991995:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788291968 00000100:00100000:2.0:1787560549.992092:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 110 00000100:00100000:2.0:1787560549.992104:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:10527:x1874392788291968:12345-192.168.201.56@tcp:58:lfs.0 00010000:00010000:2.0:1787560549.992989:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.993015:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560549.993029:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560549.993725:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787560549.993880:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:10527:x1874392788291968:12345-192.168.201.56@tcp:58:lfs.0 Request processed in 1746us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560549.993894:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 110 00000100:00100000:2.0:1787560550.010711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.011157:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788292096 00000100:00100000:1.0:1787560550.011172:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788292096 00000100:00100000:1.0:1787560550.011267:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 111 00000100:00100000:1.0:1787560550.011321:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:10527:x1874392788292096:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560550.011361:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560550.011389:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f75d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92468 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.011465:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.011478:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f75d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92468 expref: 55 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.011503:0:6706:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.011520:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f75d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92468 expref: 55 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.011537:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:1.0:1787560550.011540:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560550.011544:0:6706:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f75d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92468 expref: 55 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.011552:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261e00, rc 0) 00000100:00100000:1.0:1787560550.011644:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:10527:x1874392788292096:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 342us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560550.011653:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 111 00000100:00080000:2.0:1787560550.012318:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787560550.159432:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787560550.201636:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787560550.201662:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:0.0:1787560550.223657:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560550.223672:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560550.223742:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787560550.223751:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787560550.226721:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815570816:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787560550.226909:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9989970c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560550.238692:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815570816:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787560550.239083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560550.239208:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788292224 00000100:00100000:0.0:1787560550.239217:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788292224 00000100:00100000:0.0:1787560550.239287:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 112 00000100:00100000:0.0:1787560550.239298:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:10528:x1874392788292224:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787560550.239339:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787560550.240060:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:10528:x1874392788292224:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 757us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560550.240091:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 112 00000100:00100000:2.0:1787560550.252841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.253138:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788292352 00000100:00100000:1.0:1787560550.253161:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788292352 00000100:00100000:1.0:1787560550.253315:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 113 00000100:00100000:1.0:1787560550.253330:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:10528:x1874392788292352:12345-192.168.201.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787560550.253440:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f764 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.253618:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f764 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.253635:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f764 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.253792:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f76b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.253816:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f76b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.253831:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f76b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254253:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254265:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254275:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560550.254320:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787560550.254325:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560550.254338:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254432:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f764 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254439:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f764 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254446:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f764 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254452:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560550.254456:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f764 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254463:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f764 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254475:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:1.0:1787560550.254478:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560550.254482:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f764 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254488:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f764 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254505:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f76b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254511:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f76b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254517:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f76b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254527:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560550.254530:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f76b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254535:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f76b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254542:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff93d995c27e00) 00010000:00010000:1.0:1787560550.254545:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560550.254547:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f76b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254553:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f76b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254568:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254574:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254580:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254584:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560550.254587:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254592:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254609:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:1.0:1787560550.254611:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560550.254614:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.254620:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.254720:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:10528:x1874392788292352:12345-192.168.201.56@tcp:34:lhsmtool_posix.0 Request processed in 1391us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560550.254729:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 113 00000100:00100000:2.0:1787560550.261734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560550.261812:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788292608 00000100:00100000:3.0:1787560550.261822:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788292608 00000100:00100000:2.0:1787560550.262329:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:2.0:1787560550.262341:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:10528:x1874392788292608:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560550.262371:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560550.262391:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f779 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9246f expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262486:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262513:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262525:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560550.262537:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787560550.262633:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262640:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f780 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262646:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262652:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560550.262656:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262662:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f780 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262675:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:2.0:1787560550.262678:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787560550.262683:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f780 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262689:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262730:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f779 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9246f expref: 57 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262749:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:2.0:1787560550.262752:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560550.262757:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f779 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9246f expref: 57 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.262767:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710e00, rc 0) 00000100:00100000:2.0:1787560550.262831:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:10528:x1874392788292608:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 493us (1106us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787560550.262838:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 114 00000100:00100000:2.0:1787560550.267842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560550.268232:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788292736 00000100:00100000:0.0:1787560550.268244:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788292736 00000100:00100000:0.0:1787560550.268339:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00100000:0.0:1787560550.268350:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:10528:x1874392788292736:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787560550.268392:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787560550.268485:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:10528:x1874392788292736:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 137us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560550.268493:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 115 00000100:00100000:3.0:1787560550.280575:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.280663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788292992 00000100:00100000:1.0:1787560550.280679:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788292992 00000100:00100000:1.0:1787560550.280760:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 116 00000100:00100000:1.0:1787560550.280772:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:10528:x1874392788292992:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560550.280791:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560550.280794:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787560550.280820:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673f71e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92453 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.281085:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:1.0:1787560550.281092:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560550.281109:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f78e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92476 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787560550.283657:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787560550.283919:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f795 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.283947:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.283958:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.284022:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f78e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92476 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.284042:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f795 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92476 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.284052:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d995c27e00) 00010000:00010000:1.0:1787560550.284054:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560550.284058:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261200, rc 0) 00000100:00100000:1.0:1787560550.284517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:10528:x1874392788292992:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 3745us (4066us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787560550.284527:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 116 00000100:00100000:1.0:1787560550.317050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560550.317164:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788293248 00000100:00100000:2.0:1787560550.317174:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788293248 00000100:00100000:2.0:1787560550.317230:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 117 00000100:00100000:2.0:1787560550.317240:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:10528:x1874392788293248:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787560550.317315:0:11858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560550.317339:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f795 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92476 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317357:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d995c27e00) 00010000:00010000:2.0:1787560550.317367:0:11858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560550.317387:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f7a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317400:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317477:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317493:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f7aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x538bcd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317501:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f7aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x538bcd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317508:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f7aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x538bcd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317578:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f7a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317585:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f7a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317592:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f7a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317598:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560550.317602:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f7a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317609:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f7a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317618:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:2.0:1787560550.317621:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560550.317626:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f7a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317638:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f7a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317650:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f7aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x538bcd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317656:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f7aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x538bcd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317663:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f7aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x538bcd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317669:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560550.317672:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f7aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x538bcd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317679:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f7aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x538bcd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317686:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x538bcd4 (ffff93d987fffc00) 00010000:00010000:2.0:1787560550.317689:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560550.317692:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f7aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x538bcd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.317698:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f7aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x538bcd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560550.317777:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:10528:x1874392788293248:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 538us (737us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560550.317785:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 117 00000100:00100000:2.0:1787560550.330174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560550.330325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560550.330361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560550.330390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560550.330418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560550.330468:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788293760 00000100:00100000:3.0:1787560550.330478:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788293760 00000100:00100000:3.0:1787560550.330521:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788293632 00000100:00100000:3.0:1787560550.330525:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788293632 00000100:00100000:3.0:1787560550.330565:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:3.0:1787560550.330574:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788293760:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560550.330641:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788293760:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 67us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560550.330648:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:3.0:1787560550.330664:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:3.0:1787560550.330671:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2344:x1874392788293632:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560550.330696:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2344:x1874392788293632:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 25us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560550.330702:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:1.0:1787560550.333411:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788293504 00000100:00100000:1.0:1787560550.333425:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788293504 00000100:00100000:1.0:1787560550.333494:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 288 00000100:00100000:1.0:1787560550.333505:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788293504:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560550.333575:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788293504:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 73us (3250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560550.333582:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 288 00000100:00080000:2.0:1787560550.336440:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560550.339888:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788293376 00000100:00100000:0.0:1787560550.339901:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788293376 00000100:00100000:0.0:1787560550.339965:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788293888 00000100:00100000:0.0:1787560550.339969:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788293888 00000100:00100000:0.0:1787560550.340029:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:0.0:1787560550.340039:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2344:x1874392788293888:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560550.340131:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2344:x1874392788293888:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 93us (9712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560550.340139:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:0.0:1787560550.340168:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:0.0:1787560550.340175:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:10528:x1874392788293376:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560550.340185:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560550.340207:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101a00/0xe34191b05673f7b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9247d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.340241:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.340268:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.340279:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.340368:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101a00/0xe34191b05673f7b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9247d expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.340386:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9247d expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.340395:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:0.0:1787560550.340397:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787560550.340400:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100200, rc 0) 00000100:00100000:0.0:1787560550.340628:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:10528:x1874392788293376:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 453us (10465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560550.340634:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00080000:2.0:1787560550.341064:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560550.349632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.349714:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788294144 00000100:00100000:1.0:1787560550.349724:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788294144 00000100:00100000:1.0:1787560550.349780:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 119 00000100:00100000:1.0:1787560550.349790:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:10528:x1874392788294144:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787560550.349910:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.349926:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.349937:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560550.350180:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1787560550.350189:0:6706:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379103340783ns, next at 380103338562ns, rc = 0 00000004:00010000:1.0:1787560550.350266:0:6706:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000495a4117 reply state 00000000efbd2c66 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.350276:0:6706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560550.350357:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:10528:x1874392788294144:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 568us (734us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787560550.350365:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 119 00010000:00010000:2.0:1787560550.351917:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.351930:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.351938:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.351944:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560550.351948:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.351956:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.351971:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:2.0:1787560550.351974:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787560550.351980:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.351986:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f7bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560550.377988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560550.378330:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788294272 00000100:00100000:0.0:1787560550.378340:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788294272 00000100:00100000:0.0:1787560550.378450:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:0.0:1787560550.378462:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:10528:x1874392788294272:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560550.378486:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560550.378508:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f7c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92484 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.378570:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f7c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92484 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.378599:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f7c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92484 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.378620:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:0.0:1787560550.378623:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560550.378627:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100c00, rc 0) 00000100:00100000:0.0:1787560550.378692:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:10528:x1874392788294272:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 232us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560550.378699:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:1.0:1787560550.389898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560550.389976:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788294400 00000100:00100000:3.0:1787560550.389986:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788294400 00000100:00100000:3.0:1787560550.390035:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:3.0:1787560550.390046:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2342:x1874392788294400:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787560550.390367:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2342:x1874392788294400:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 Request processed in 321us (520us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787560550.390375:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:3.0:1787560550.397209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.397344:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788294656 00000100:00100000:1.0:1787560550.397354:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788294656 00000100:00100000:1.0:1787560550.397420:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:1.0:1787560550.397432:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:10528:x1874392788294656:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787560550.397763:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:10528:x1874392788294656:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 332us (563us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787560550.397786:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:2.0:1787560550.403426:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560550.411590:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788294912 00000100:00100000:3.0:1787560550.411606:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788294912 00000100:00100000:3.0:1787560550.411670:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00100000:3.0:1787560550.411682:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:10528:x1874392788294912:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787560550.411810:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:10528:x1874392788294912:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 131us (8397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560550.411817:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 121 00000100:00100000:2.0:1787560550.415344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560550.415701:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788295040 00000100:00100000:3.0:1787560550.415712:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788295040 00000100:00100000:3.0:1787560550.415772:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 122 00000100:00100000:3.0:1787560550.415782:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:10528:x1874392788295040:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560550.415800:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560550.415819:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f7cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9248b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.415913:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f7d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.415927:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.415938:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560550.415991:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560550.416008:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.416034:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f7cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9248b expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.416056:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f7d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9248b expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.416064:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:3.0:1787560550.416067:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787560550.416070:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea200, rc 0) 00000100:00100000:3.0:1787560550.416135:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:10528:x1874392788295040:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 354us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560550.416142:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 122 00000100:00100000:2.0:1787560550.422051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.422139:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788295168 00000100:00100000:1.0:1787560550.422156:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788295168 00000100:00100000:1.0:1787560550.422221:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:1.0:1787560550.422233:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2342:x1874392788295168:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560550.422251:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560550.422273:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e69c68c7/0xe34191b05673f7db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92492 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560550.422301:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c0266, blocks: 0x1 00010000:00010000:1.0:1787560550.422320:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1787560550.422324:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560550.422334:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e69c68c7/0xe34191b05673f7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92492 expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.422355:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e69c68c7/0xe34191b05673f7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92492 expref: 10 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.422369:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260e00, rc 0) 00000100:00100000:1.0:1787560550.422434:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:2342:x1874392788295168:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 204us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560550.422441:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:2.0:1787560550.432804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560550.433891:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788295424 00000100:00100000:0.0:1787560550.433903:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788295424 00000100:00100000:0.0:1787560550.433967:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 123 00000100:00100000:0.0:1787560550.433979:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:10528:x1874392788295424:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787560550.434090:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:10528:x1874392788295424:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 114us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560550.434098:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 123 00000100:00100000:3.0:1787560550.440537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.441190:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788295552 00000100:00100000:1.0:1787560550.441200:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788295552 00000100:00100000:1.0:1787560550.441264:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:1.0:1787560550.441276:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:10528:x1874392788295552:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560550.441307:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560550.441326:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92499 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.441359:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e69c68c7/0xe34191b05673f7db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92492 expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.441368:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560550.441374:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560550.441379:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.441413:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e69c68c7/0xe34191b05673f7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92492 expref: 11 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.441426:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e69c68c7/0xe34191b05673f7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92492 expref: 11 pid: 6685 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.441440:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815570944:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560550.441529:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bae27180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560550.445314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560550.445830:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815570944:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560550.445883:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.445905:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260800, rc 0) 00000100:00100000:3.0:1787560550.445966:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:10528:x1874392788295552:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 4692us (5438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560550.445975:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:0.0:1787560550.447620:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788295680 00000100:00100000:0.0:1787560550.447636:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788295680 00010000:00010000:0.0:1787560550.447679:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e69c68c7/0xe34191b05673f7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92492 expref: 11 pid: 6685 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560550.447719:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:0.0:1787560550.447729:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:2342:x1874392788295680:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560550.447744:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560550.447781:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e69c68c7/0xe34191b05673f7db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92492 expref: 11 pid: 6685 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.447795:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e69c68c7/0xe34191b05673f7db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92492 expref: 11 pid: 6685 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.447819:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e69c68c7/0xe34191b05673f7db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92492 expref: 11 pid: 6685 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.447835:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560550.447839:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560550.447883:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.447894:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.447931:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 10 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560550.447946:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874392815571072:192.168.201.56@tcp:105: 00000100:00100000:0.0:1787560550.448016:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9989970c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560550.454201:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1874392815571072:192.168.201.56@tcp:105: 00010000:00010000:0.0:1787560550.454229:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560550.454283:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:2342:x1874392788295680:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 6555us (8980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560550.454303:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:2.0:1787560550.456737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560550.456802:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788295808 00000100:00100000:0.0:1787560550.456810:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788295808 00002000:00100000:0.0:1787560550.457059:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93d9bf921f80 x1874392788295808/t0(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:666/0 lens 504/0 e 0 to 0 dl 1787560561 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787560550.457080:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9bf921f80 with x1874392788295808 ext(0->12) 00002000:00010000:0.0:1787560550.457087:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d9bf921f80 00000100:00100000:1.0:1787560550.457215:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:1.0:1787560550.457232:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:2343:x1874392788295808:12345-192.168.201.56@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787560550.457622:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+12:2343:x1874392788295808:12345-192.168.201.56@tcp:4:lhsmtool_posix.0 Request processed in 397us (889us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787560550.457638:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 2 00002000:00100000:1.0:1787560550.457645:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff93d9bf921f80 x1874392788295808/t4294967308(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:666/0 lens 504/448 e 0 to 0 dl 1787560561 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787560550.457653:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9bf921f80 with x1874392788295808 ext(0->12) 00002000:00010000:1.0:1787560550.457656:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d9bf921f80 00000100:00100000:2.0:1787560550.459658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560550.459704:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788295936 00000100:00100000:3.0:1787560550.459720:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788295936 00000100:00100000:3.0:1787560550.459763:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 124 00000100:00100000:3.0:1787560550.459773:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:10528:x1874392788295936:12345-192.168.201.56@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787560550.511276:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:10528:x1874392788295936:12345-192.168.201.56@tcp:44:lhsmtool_posix.0 Request processed in 51492us (51610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560550.511289:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 124 00000001:00080000:0.0:1787560550.512298:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000001:00080000:0.0:1787560550.512324:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787560550.512330:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787560550.512373:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d9bf9dd6c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787560550.512377:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d99048de00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d9bf9dd480 00000020:00080000:0.0:1787560550.512380:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d99048d400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d9b391e800 00000004:00080000:0.0:1787560550.512419:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1787560550.512434:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787560550.512448:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d987d46240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787560550.512451:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d9bf8da000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d987d460c0 00000020:00080000:0.0:1787560550.512453:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d9bf8daa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d9b3874000 00000100:00100000:0.0:1787560550.512601:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815571200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787560550.512654:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560550.512731:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815571200 00000100:00100000:0.0:1787560550.512738:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815571200 00000100:00100000:0.0:1787560550.512787:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560550.512796:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815571200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787560550.512834:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1787560550.512894:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c0265, atime: 0x6a8c0265, ctime: 0x6a8c0265, blocks: 0xb 00010000:00010000:0.0:1787560550.512903:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090ed3674/0xe34191b05673f7e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.512918:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1787560550.512923:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560550.512930:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090ed3674/0xe34191b05673f7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.512947:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090ed3674/0xe34191b05673f7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.512956:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090ed3674/0xe34191b05673f7e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.512963:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090ed3674/0xe34191b05673f7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.512981:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787560550.513474:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815571328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787560550.513509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560550.513533:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560550.513539:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815571456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787560550.513558:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560550.513587:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815571328 00000100:00100000:2.0:1787560550.513591:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815571328 00000100:00100000:2.0:1787560550.513619:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815571456 00000100:00100000:2.0:1787560550.513622:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815571456 00000100:00100000:2.0:1787560550.513634:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787560550.513639:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874392815571328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787560550.513652:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787560550.513666:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.513681:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a109359/0xe34191b05673f5ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f8 expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.513689:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787560550.513701:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560550.513705:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.513730:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a109359/0xe34191b05673f5ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f8 expref: 11 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.513743:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a109359/0xe34191b05673f5ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f8 expref: 11 pid: 6685 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560550.513754:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815571584:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560550.513808:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79b240 going to sleep for 11 seconds 00000100:00080000:2.0:1787560550.513821:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1787560550.513991:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787560550.514225:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787560550.514887:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874392815571200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2088us (2228us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787560550.514898:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560550.514927:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560550.514937:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1874392815571456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787560550.515043:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787560550.515052:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787560550 00002000:00010000:0.0:1787560550.515054:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787560550.515056:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787560550 -> 1787560550 00002000:00010000:0.0:1787560550.515058:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787560550.515192:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787560550.515198:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1787560550.515229:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d9b3951180, transno 4294967301 00000004:00080000:2.0:1787560550.515240:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1787560550.515254:0:3312:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff93d9bf8a4000 x1874392815571200/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787560566 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787560550.515266:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d9bf8a4000/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787560550.515271:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf8a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815571200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787560550.515324:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1874392815571456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 390us (1765us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787560550.515331:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1787560550.515354:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560550.515361:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090ed3674/0xe34191b05673f7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.515371:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560550.515375:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090ed3674/0xe34191b05673f7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.515385:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090ed3674/0xe34191b05673f7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.515413:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090ed3674/0xe34191b05673f7e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.515420:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090ed3674/0xe34191b05673f7e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.515438:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560550.515439:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560550.515441:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787560550.516776:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d986a00380/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787560550.516787:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815571456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787560550.520097:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815571584:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560550.520138:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.520574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560550.520643:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788296064 00000100:00100000:0.0:1787560550.520650:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788296064 00010000:00010000:0.0:1787560550.520685:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a109359/0xe34191b05673f5ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f8 expref: 12 pid: 6685 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560550.520723:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:0.0:1787560550.520733:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+12:2342:x1874392788296064:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560550.520748:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560550.520755:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a109359/0xe34191b05673f5ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f8 expref: 12 pid: 6685 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.520767:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a109359/0xe34191b05673f5ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f8 expref: 12 pid: 6685 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.520789:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a109359/0xe34191b05673f5ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923f8 expref: 12 pid: 6685 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.520806:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560550.520810:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560550.520816:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.520825:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.520891:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560550.520938:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:2342:x1874392788296064:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 206us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560550.520945:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 56 00010000:00010000:3.0:1787560550.521078:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.521088:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.521096:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.521104:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.521118:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787560550.521622:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3313:x1874392815571328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7980us (8110us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787560550.521630:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1787560550.521942:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560550.521950:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.521959:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711800 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560550.521964:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.521973:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.521987:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.521994:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e988a256/0xe34191b05673f7f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.522014:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560550.522016:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560550.522018:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787560550.524114:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d986a00000/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787560550.524130:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815571328:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787560550.528180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560550.528351:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788296192 00000100:00100000:0.0:1787560550.528360:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788296192 00000100:00100000:1.0:1787560550.529218:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:1.0:1787560550.529247:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:2343:x1874392788296192:12345-192.168.201.56@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787560550.578302:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787560550.578319:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1787560550.578327:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1787560550.578341:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1787560550.578504:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788296192:12345-192.168.201.56@tcp:16:lhsmtool_posix.0 Request processed in 49269us (50328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560550.578516:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:0.0:1787560550.583210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.583302:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788296448 00000100:00100000:1.0:1787560550.583313:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788296448 00000100:00100000:1.0:1787560550.585874:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 125 00000100:00100000:1.0:1787560550.585901:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:10528:x1874392788296448:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787560550.585955:0:6706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560550.585994:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673f7d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9248b expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.586017:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:1.0:1787560550.586022:0:6706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560550.586052:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.586065:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.586075:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560550.586308:0:6706:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8f2120b reply state 000000008a295ac5 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.586318:0:6706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560550.586422:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:10528:x1874392788296448:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 536us (3222us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787560550.586430:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 125 00000100:00100000:3.0:1787560550.590157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560550.600291:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788296576 00000100:00100000:0.0:1787560550.600306:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788296576 00000100:00100000:0.0:1787560550.600373:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:0.0:1787560550.600384:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788296576:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 00010000:00010000:2.0:1787560550.600415:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.600425:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.600455:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.600461:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560550.600465:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.600473:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.600488:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:2.0:1787560550.600491:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560550.600495:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.600500:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f7f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560550.600622:0:8101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787560550.600626:0:8101:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787560550 -> 1787560550 00002000:00010000:0.0:1787560550.600628:0:8101:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787560549 00002000:00010000:0.0:1787560550.600630:0:8101:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787560550 -> 1787560550 00002000:00010000:0.0:1787560550.600632:0:8101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787560550.600698:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2343:x1874392788296576:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 Request processed in 315us (10558us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787560550.600706:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:3.0:1787560550.605992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560550.606134:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788296832 00000100:00100000:0.0:1787560550.606155:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788296832 00000100:00100000:0.0:1787560550.606219:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 126 00000100:00100000:0.0:1787560550.606228:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:10528:x1874392788296832:12345-192.168.201.56@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787560550.606290:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.606303:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9247d expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.606310:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.606339:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9247d expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.606369:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9247d expref: 15 pid: 5839 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560550.606381:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3938000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815571712:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560550.606468:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98706f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560550.608266:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b393a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815571840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560550.608322:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560550.611054:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3938000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815571712:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560550.611094:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560550.612046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560550.612310:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788296960 00000100:00100000:2.0:1787560550.612320:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788296960 00010000:00010000:2.0:1787560550.612357:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9247d expref: 16 pid: 5839 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560550.612390:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:2.0:1787560550.612400:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:2342:x1874392788296960:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560550.612414:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560550.612434:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9247d expref: 16 pid: 5839 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.612453:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9247d expref: 16 pid: 5839 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.612473:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f7b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9247d expref: 16 pid: 5839 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.612488:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:2.0:1787560550.612493:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.612502:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.612509:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.612533:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560550.612576:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:2342:x1874392788296960:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 177us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560550.612582:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 57 00010000:00010000:3.0:1787560550.613200:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.613217:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.613243:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.613250:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.613257:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.613262:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560550.613267:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.613274:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.613284:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:3.0:1787560550.613287:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787560550.613291:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.613297:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f7fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560550.613341:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:10528:x1874392788296832:12345-192.168.201.56@tcp:55:lhsmtool_posix.0 Request processed in 7113us (7358us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787560550.613350:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 126 00000100:00100000:0.0:1787560550.613921:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815571840 00000100:00100000:0.0:1787560550.613928:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815571840 00000100:00100000:1.0:1787560550.615732:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787560550.615747:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815571840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560550.615774:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1787560550.615903:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815571840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (7581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560550.616119:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787560550.616135:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:2.0:1787560550.616165:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d986a00380, transno 4294967309 00000004:00080000:2.0:1787560550.616177:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d986a00000, transno 4294967310 00000100:00100000:2.0:1787560550.616190:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b393a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815571840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560550.617549:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787560550.620320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560550.620430:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788297088 00000100:00100000:2.0:1787560550.620452:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788297088 00000100:00100000:2.0:1787560550.620536:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:2.0:1787560550.620547:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2345:x1874392788297088:12345-192.168.201.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787560550.620590:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.620611:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.620620:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560550.620625:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560550.620630:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.620666:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.620681:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 7 pid: 6684 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560550.620696:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874392815571968:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560550.620781:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987d460c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560550.623705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560550.624266:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6683:1874392815571968:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560550.624291:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560550.625691:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788297216 00000100:00100000:0.0:1787560550.625704:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788297216 00010000:00010000:0.0:1787560550.625745:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 8 pid: 6684 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560550.625785:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:0.0:1787560550.625795:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788297216:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560550.625809:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560550.625831:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 8 pid: 6684 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.625843:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 8 pid: 6684 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.625897:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a61aa2e/0xe34191b05673f7e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92499 expref: 8 pid: 6684 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.625912:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560550.626242:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560550.626249:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.626269:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.626347:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560550.626404:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2343:x1874392788297216:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 609us (2708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560550.626412:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00010000:00010000:0.0:1787560550.626470:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.626479:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.626502:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.626509:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.626516:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.626522:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560550.626526:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.626535:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.626553:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.626560:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043ba6e7d/0xe34191b05673f805 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560550.626627:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788297088:12345-192.168.201.56@tcp:1:lhsmtool_posix.0 Request processed in 6083us (6391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560550.626634:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:3.0:1787560550.632688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.632760:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788297472 00000100:00100000:1.0:1787560550.632770:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788297472 00000100:00100000:1.0:1787560550.632838:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 127 00000100:00100000:1.0:1787560550.632872:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:10528:x1874392788297472:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787560550.632965:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f80c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.632981:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f80c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.632993:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f80c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.633819:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.633838:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f7c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92484 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.633882:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.634018:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f7c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92484 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.634033:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f7c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92484 expref: 15 pid: 5839 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.634235:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874392815572096:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560550.634526:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560550.639634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560550.639790:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788297600 00000100:00100000:2.0:1787560550.639808:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788297600 00000100:00100000:1.0:1787560550.639808:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874392815572096:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560550.639836:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.639842:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f7c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92484 expref: 16 pid: 5839 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560550.639910:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:2.0:1787560550.640002:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+16:2343:x1874392788297600:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560550.640020:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560550.640027:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f7c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92484 expref: 16 pid: 5839 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.640041:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f7c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92484 expref: 16 pid: 5839 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.640072:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f7c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92484 expref: 16 pid: 5839 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.640090:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:2.0:1787560550.640095:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.640105:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.640137:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560550.640175:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560550.640221:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560550.640225:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:2343:x1874392788297600:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 307us (604us total) trans 0 rc 0/0 00010000:00010000:3.0:1787560550.640229:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560550.640413:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787560550.640563:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787560550.640606:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787560550.640682:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4227800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5838:1874392815572224:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787560550.640727:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560550.640759:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bf9ddd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560550.642102:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815572224 00000100:00100000:0.0:1787560550.642112:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815572224 00000100:00100000:0.0:1787560550.642189:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560550.642200:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1874392815572224:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787560550.642303:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1874392815572224:12345-0@lo:1000:mdt00_001.0 Request processed in 105us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560550.642310:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560550.642671:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4227800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5838:1874392815572224:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787560550.644178:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1787560550.644269:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4227800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5838:1874392815572352:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787560550.644332:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560550.644370:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bf9dd600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560550.645083:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815572352 00000100:00100000:0.0:1787560550.645092:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815572352 00000100:00100000:0.0:1787560550.645157:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560550.645167:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1874392815572352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787560550.645386:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1874392815572352:12345-0@lo:1000:mdt00_001.0 Request processed in 221us (1054us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787560550.645394:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560550.645560:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4227800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5838:1874392815572352:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787560550.645599:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645609:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645616:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645630:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560550.645635:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645643:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560550.645654:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 59 00010000:00010000:3.0:1787560550.645659:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:3.0:1787560550.645662:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560550.645667:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645673:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f813 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645703:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645709:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645715:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645720:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560550.645723:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645729:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645748:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:3.0:1787560550.645751:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560550.645756:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f75d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92468 expref: 18 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645767:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f75d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92468 expref: 18 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645777:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f75d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92468 expref: 18 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.645803:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f75d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92468 expref: 18 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560550.645813:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874392815572480:192.168.201.56@tcp:105: 00000100:00100000:3.0:1787560550.646761:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bf9dd600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560550.654578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560550.654612:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b451ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874392815572480:192.168.201.56@tcp:105: 00010000:00010000:0.0:1787560550.654659:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654670:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f756 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.654694:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788297728 00000100:00100000:1.0:1787560550.654702:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788297728 00010000:00010000:0.0:1787560550.654704:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f81a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654717:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f81a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654727:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f81a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654735:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f81a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654741:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f81a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654748:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f81a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654753:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101e00 already unused, calling callback (ffffffffc21364f0) 00000100:00100000:1.0:1787560550.654757:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 31 00010000:00010000:0.0:1787560550.654757:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f81a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654764:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f81a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.654767:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10527:x1874392788297728:12345-192.168.201.56@tcp:49:lfs.0 00010000:00010000:0.0:1787560550.654774:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:0.0:1787560550.654776:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560550.654787:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f81a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654792:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f81a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654801:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f80c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654806:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f80c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654810:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f80c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654815:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560550.654817:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f80c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654822:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f80c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654842:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:0.0:1787560550.654844:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787560550.654871:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f80c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.654877:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f80c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.654902:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:10527:x1874392788297728:12345-192.168.201.56@tcp:49:lfs.0 Request processed in 136us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560550.654909:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:0.0:1787560550.659509:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+18:10528:x1874392788297472:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 26648us (26819us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787560550.659524:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 127 00000020:00080000:0.0:1787560550.659543:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787560550.659903:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560550.659908:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560550.660398:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787560550.660405:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787560550.665579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.666053:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788297984 00000100:00100000:1.0:1787560550.666063:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788297984 00000100:00100000:1.0:1787560550.666147:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00100000:1.0:1787560550.666159:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae746450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+18:10528:x1874392788297984:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787560550.666779:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787560550.666948:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787560550.666991:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.667005:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.667016:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.667032:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.667038:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.667045:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.667058:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787560550.667169:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae746450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:10528:x1874392788297984:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 1010us (1597us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787560550.667178:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 32 00000020:00080000:1.0:1787560550.667182:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787560550.667418:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560550.667425:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.667432:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560550.667437:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.667445:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.667458:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff93d995c27b00) 00010000:00010000:0.0:1787560550.667461:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787560550.667466:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.667471:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673f821 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560550.667486:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560550.667489:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560550.667490:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560550.670993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.671274:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788298240 00000100:00100000:1.0:1787560550.671283:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788298240 00000100:00100000:1.0:1787560550.671341:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 128 00000100:00100000:1.0:1787560550.671351:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:10527:x1874392788298240:12345-192.168.201.56@tcp:58:lfs.0 00000040:00080000:1.0:1787560550.671619:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787560550.671705:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:10527:x1874392788298240:12345-192.168.201.56@tcp:58:lfs.0 Request processed in 356us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560550.671713:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 128 00000100:00100000:3.0:1787560550.728124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.728231:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788298368 00000100:00100000:1.0:1787560550.728260:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788298368 00000100:00100000:1.0:1787560550.728323:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 129 00000100:00100000:1.0:1787560550.728335:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:10530:x1874392788298368:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560550.728362:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560550.728394:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f828 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924a0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.728452:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f82f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.728466:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f82f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.728477:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f82f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.728491:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673f836 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.728498:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673f836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.728504:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673f836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.729135:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.729158:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92461 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.729167:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.729204:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92461 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.729232:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92461 expref: 21 pid: 5837 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.729320:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815572608:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560550.729503:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba79bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560550.738192:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815572608:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560550.738230:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560550.738580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560550.738946:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788298624 00000100:00100000:2.0:1787560550.738954:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788298624 00000100:00100000:2.0:1787560550.739010:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:2.0:1787560550.739021:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:5585:x1874392788298624:12345-192.168.201.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787560550.739342:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:5585:x1874392788298624:12345-192.168.201.56@tcp:35:ldlm_bl.0 Request processed in 322us (762us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787560550.739350:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:3.0:1787560550.745136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560550.748128:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788298752 00000100:00100000:1.0:1787560550.748152:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788298752 00010000:00010000:1.0:1787560550.748206:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92461 expref: 23 pid: 5837 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560550.748383:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:1.0:1787560550.748404:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e10450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:2343:x1874392788298752:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560550.748423:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560550.748430:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92461 expref: 23 pid: 5837 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.748561:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92461 expref: 23 pid: 5837 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.748585:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f748 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92461 expref: 23 pid: 5837 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.748623:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:1.0:1787560550.748628:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.748638:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.748645:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560550.748681:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560550.748787:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e10450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:2343:x1874392788298752:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 395us (3661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560550.748794:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 60 00010000:00010000:3.0:1787560550.748987:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749008:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560550.749048:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787560550.749052:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560550.749070:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749083:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749092:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f82f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749098:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f82f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749105:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f82f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749112:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560550.749116:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f82f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749125:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f82f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749135:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:3.0:1787560550.749149:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560550.749152:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f82f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749167:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b05673f82f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749180:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673f836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749187:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673f836 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749193:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673f836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749198:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560550.749201:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673f836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749207:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673f836 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749215:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff93d995c27200) 00010000:00010000:3.0:1787560550.749217:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560550.749219:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673f836 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749224:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673f836 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749272:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673f828 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924a0 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749287:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924a0 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560550.749299:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:3.0:1787560550.749301:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560550.749303:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260c00, rc 0) 00000100:00100000:3.0:1787560550.749334:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:10530:x1874392788298368:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 21002us (21232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560550.749341:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 129 00010000:00010000:0.0:1787560551.186318:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560551.636281:0:12049:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560551.636292:0:12049:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560551.636338:0:12049:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787560551.636343:0:12049:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787560551.696268:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560551.696278:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560551.696314:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787560551.696323:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787560551.696463:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b393ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815572736:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787560551.696561:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98706f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560551.708049:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b393ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815572736:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787560551.711457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560551.711584:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788298880 00000100:00100000:2.0:1787560551.711593:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788298880 00000100:00100000:2.0:1787560551.711653:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:2.0:1787560551.711663:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:10541:x1874392788298880:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787560551.711698:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787560551.711811:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:10541:x1874392788298880:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 136us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560551.711831:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 130 00000100:00100000:3.0:1787560551.721228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560551.722058:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788299136 00000100:00100000:2.0:1787560551.722070:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788299136 00000100:00100000:2.0:1787560551.722142:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 131 00000100:00100000:2.0:1787560551.722153:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:10541:x1874392788299136:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560551.722173:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560551.722193:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f844 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924a7 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560551.722289:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f84b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560551.722304:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f84b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560551.722317:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f84b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560551.722328:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787560551.722455:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673f844 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924a7 expref: 24 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560551.722472:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f84b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924a7 expref: 23 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560551.722480:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:2.0:1787560551.722483:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560551.722487:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711600, rc 0) 00000100:00100000:2.0:1787560551.722558:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:10541:x1874392788299136:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 406us (1340us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787560551.722576:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 131 00000100:00100000:2.0:1787560551.732610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560551.732657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560551.732751:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788299264 00000100:00100000:3.0:1787560551.732761:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788299264 00000100:00100000:1.0:1787560551.732762:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788299520 00000100:00100000:1.0:1787560551.732765:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788299520 00000100:00100000:3.0:1787560551.732830:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:3.0:1787560551.732841:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:2342:x1874392788299264:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560551.732874:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787560551.732882:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 132 00000100:00100000:1.0:1787560551.732891:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:10541:x1874392788299520:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787560551.732896:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673f84b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924a7 expref: 24 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560551.732913:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:3.0:1787560551.732919:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560551.732968:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:2342:x1874392788299264:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 129us (369us total) trans 0 rc 0/0 00010000:00010000:1.0:1787560551.732970:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f859 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560551.732976:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00010000:00010000:1.0:1787560551.732984:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560551.732994:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560551.733507:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f859 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560551.733524:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f859 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560551.733531:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f859 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560551.733537:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560551.733541:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f859 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560551.733548:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f859 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560551.733557:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:1.0:1787560551.733560:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787560551.733564:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f859 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560551.733569:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f859 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560551.733691:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:10541:x1874392788299520:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 800us (1032us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787560551.733699:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 132 00000040:00080000:2.0:1787560551.733810:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787560551.733824:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787560551.734546:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787560551.734557:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787560551.744485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560551.744570:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788299776 00000100:00100000:3.0:1787560551.744584:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788299776 00000100:00100000:3.0:1787560551.744643:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:3.0:1787560551.744653:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:10541:x1874392788299776:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787560551.744924:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:10541:x1874392788299776:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 271us (448us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787560551.744932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 34 00010000:00010000:0.0:1787560552.207304:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560552.655057:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815573120:0@lo:400:kworker.0 00000100:00100000:2.0:1787560552.655139:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560552.655205:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787560552.655214:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815572992:0@lo:400:kworker.0 00000100:00100000:2.0:1787560552.655242:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560552.655253:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815572864:0@lo:400:kworker.0 00000100:00100000:2.0:1787560552.655264:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815573504:0@lo:400:kworker.0 00000100:00100000:3.0:1787560552.655365:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815573120 00000100:00100000:3.0:1787560552.655372:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815573120 00000100:00100000:3.0:1787560552.655423:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815572992 00000100:00100000:3.0:1787560552.655427:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815572992 00000100:00100000:3.0:1787560552.655448:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787560552.655457:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815573120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560552.655559:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815573248:0@lo:400:kworker.0 00000100:00100000:1.0:1787560552.655578:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560552.656117:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560552.659283:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815573504 00000100:00100000:2.0:1787560552.659299:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815573504 00000100:00100000:2.0:1787560552.659372:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787560552.659386:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815573504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560552.659478:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815573504:12345-0@lo:400:kworker.0 Request processed in 97us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560552.659485:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787560552.659533:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815573504:0@lo:400:kworker.0 00000100:00080000:2.0:1787560552.659676:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560552.659681:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560552.659719:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787560552.659728:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815572992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560552.659771:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815572992:12345-0@lo:400:kworker.0 Request processed in 45us (4530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560552.659777:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787560552.659808:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815572992:0@lo:400:kworker.0 00000100:00100000:3.0:1787560552.662453:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815573120:12345-0@lo:400:kworker.0 Request processed in 6987us (7304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560552.662469:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787560552.662536:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815573120:0@lo:400:kworker.0 00000100:00100000:0.0:1787560552.662894:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560552.663141:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815572864 00000100:00100000:0.0:1787560552.663148:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815572864 00000100:00100000:0.0:1787560552.663201:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787560552.663211:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815572864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560552.663258:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815572864:12345-0@lo:400:kworker.0 Request processed in 49us (7956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560552.663264:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787560552.668082:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815572864:0@lo:400:kworker.0 00000100:00100000:1.0:1787560552.668100:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815573376:0@lo:400:kworker.0 00000100:00100000:1.0:1787560552.668191:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560552.668231:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815573248 00000100:00100000:3.0:1787560552.668239:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815573248 00000100:00100000:3.0:1787560552.668381:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787560552.668393:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874392815573248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560552.668453:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874392815573248:12345-0@lo:400:kworker.0 Request processed in 63us (5560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560552.668460:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787560552.668503:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815573248:0@lo:400:kworker.0 00000100:00080000:0.0:1787560552.669284:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560552.670338:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815573376 00000100:00100000:2.0:1787560552.670348:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815573376 00000100:00100000:2.0:1787560552.670456:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787560552.670468:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815573376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560552.670542:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815573376:12345-0@lo:400:kworker.0 Request processed in 76us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560552.670549:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787560552.671321:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815573376:0@lo:400:kworker.0 00000100:00080000:0.0:1787560552.674240:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560553.167642:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815573632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560553.167744:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560553.170298:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815573632 00000100:00100000:3.0:1787560553.170320:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815573632 00000100:00100000:3.0:1787560553.170439:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787560553.170453:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815573632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560553.170506:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560553.170624:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815573632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560553.170632:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787560553.170813:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815573632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787560553.233082:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560553.790304:0:12100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560553.790318:0:12100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560553.790379:0:12100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787560553.790386:0:12100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787560554.016455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560554.016628:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788300032 00000100:00100000:0.0:1787560554.016642:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788300032 00000100:00100000:0.0:1787560554.016744:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 133 00000100:00100000:0.0:1787560554.016758:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:10562:x1874392788300032:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560554.016795:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560554.016824:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f860 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924ae expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560554.016983:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f867 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560554.017001:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560554.017018:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560554.017048:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787560554.017237:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101000/0xe34191b05673f860 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ae expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787560554.017362:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787560554.018438:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ae expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560554.018457:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:0.0:1787560554.018461:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787560554.018466:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101e00, rc 0) 00000100:00100000:0.0:1787560554.018766:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10562:x1874392788300032:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 2008us (2321us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787560554.018775:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 133 00000100:00100000:2.0:1787560554.023641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560554.025966:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788300160 00000100:00100000:3.0:1787560554.025987:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788300160 00000100:00100000:3.0:1787560554.026063:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 134 00000100:00100000:3.0:1787560554.026076:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10562:x1874392788300160:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:3.0:1787560554.026179:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560554.026201:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560554.026214:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560554.026264:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560554.026272:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f875 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560554.026279:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560554.026295:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebc00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560554.026300:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560554.026308:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f875 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560554.028296:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:3.0:1787560554.028308:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560554.028318:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f875 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560554.028467:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560554.028612:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:10562:x1874392788300160:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 2531us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560554.028626:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 134 00000100:00100000:1.0:1787560554.180451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560554.180586:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788300288 00000100:00100000:0.0:1787560554.180601:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788300288 00000100:00100000:0.0:1787560554.180711:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:0.0:1787560554.180724:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788300288:12345-192.168.201.56@tcp:101:cat.0 00010000:00010000:0.0:1787560554.180759:0:8101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560554.180796:0:8101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b1c198c/0xe34191b05673f87c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924b5 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560554.180834:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c0266, atime: 0x6a8c0265, ctime: 0x6a8c0266, blocks: 0xb 00010000:00010000:0.0:1787560554.180899:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1787560554.180905:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560554.180918:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b1c198c/0xe34191b05673f87c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924b5 expref: 7 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560554.180967:0:8101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b1c198c/0xe34191b05673f87c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924b5 expref: 7 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560554.180984:0:8101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101000, rc 0) 00000100:00100000:0.0:1787560554.181056:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2343:x1874392788300288:12345-192.168.201.56@tcp:101:cat.0 Request processed in 333us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560554.181064:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00080000:1.0:1787560554.181352:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560554.185565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560554.185764:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788300416 00000100:00100000:2.0:1787560554.185778:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788300416 00002000:00100000:2.0:1787560554.186012:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff93d9bb0d1c00 x1874392788300416/t0(0) o3->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:670/0 lens 488/0 e 0 to 0 dl 1787560565 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560554.186027:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9bb0d1c00 with x1874392788300416 ext(0->4095) 00002000:00010000:2.0:1787560554.186035:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d9bb0d1c00 00000100:00100000:2.0:1787560554.186127:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:2.0:1787560554.186140:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788300416:12345-192.168.201.56@tcp:3:cat.0 00000100:00100000:2.0:1787560554.186487:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788300416:12345-192.168.201.56@tcp:3:cat.0 Request processed in 348us (937us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787560554.186497:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 3 00002000:00100000:2.0:1787560554.186505:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff93d9bb0d1c00 x1874392788300416/t0(0) o3->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:670/0 lens 488/4536 e 0 to 0 dl 1787560565 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560554.186513:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9bb0d1c00 with x1874392788300416 ext(0->4095) 00002000:00010000:2.0:1787560554.186517:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d9bb0d1c00 00010000:00010000:0.0:1787560554.255187:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560555.282465:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787560555.348716:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:3.0:1787560555.441573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560555.441625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560555.441659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560555.441730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560555.441759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560555.441804:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788301056 00000100:00100000:3.0:1787560555.441817:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788301056 00000100:00100000:3.0:1787560555.441933:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788300672 00000100:00100000:3.0:1787560555.441937:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788300672 00000100:00100000:3.0:1787560555.441973:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 142 00000100:00100000:3.0:1787560555.441986:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788301056:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560555.442107:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2345:x1874392788301056:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 122us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560555.442117:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 142 00000100:00100000:3.0:1787560555.442140:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 143 00000100:00100000:3.0:1787560555.442147:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:2345:x1874392788300672:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560555.442173:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:2345:x1874392788300672:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560555.442180:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 143 00000100:00100000:3.0:1787560555.442205:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788300800 00000100:00100000:3.0:1787560555.442209:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788300800 00000100:00100000:3.0:1787560555.442239:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788300928 00000100:00100000:3.0:1787560555.442241:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788300928 00000100:00100000:3.0:1787560555.442266:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00100000:3.0:1787560555.442273:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2345:x1874392788300800:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560555.442305:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2345:x1874392788300800:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 32us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560555.442312:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00100000:3.0:1787560555.442324:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00100000:3.0:1787560555.442331:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788300928:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560555.442356:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788300928:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 26us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560555.442362:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00080000:3.0:1787560555.442381:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560555.442386:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560555.442605:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788300544 00000100:00100000:0.0:1787560555.442611:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788300544 00000100:00100000:0.0:1787560555.442658:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 290 00000100:00100000:0.0:1787560555.442667:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2345:x1874392788300544:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560555.442706:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2345:x1874392788300544:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 40us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560555.442712:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 290 00000100:00100000:3.0:1787560555.747666:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815573760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560555.747749:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560555.747842:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815573760 00000100:00100000:3.0:1787560555.747868:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815573760 00000100:00100000:3.0:1787560555.747923:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787560555.747932:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874392815573760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560555.747967:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560555.748010:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874392815573760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560555.748018:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1787560555.748038:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560555.748085:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815573760:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787560555.817592:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787560555.817630:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787560555.817665:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d9bf9ddf00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787560555.817670:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d9bf946400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d98555b300 00000020:00080000:2.0:1787560555.817674:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d9bf946700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d9a5becc00 00000020:00080000:0.0:1787560555.817798:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787560555.818019:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1787560555.820444:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787560555.820456:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1787560556.303297:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560557.327084:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560557.775310:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815574016:0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.775430:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560557.775520:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815574528:0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.775552:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560557.775586:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560557.775611:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815574144:0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.775637:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.775920:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815573888:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.775964:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.776002:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815574400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.776040:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560557.776066:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560557.776073:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815574272:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.776097:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560557.776098:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815574016 00000100:00100000:1.0:1787560557.776111:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815574016 00000100:00100000:1.0:1787560557.776184:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815574144 00000100:00100000:1.0:1787560557.776187:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815574144 00000100:00100000:1.0:1787560557.776214:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815574400 00000100:00100000:1.0:1787560557.776217:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815574400 00000100:00100000:1.0:1787560557.776236:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787560557.776246:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815574016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560557.776313:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815574016:12345-0@lo:400:kworker.0 Request processed in 68us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560557.776323:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787560557.776345:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787560557.776345:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815573888 00000100:00100000:0.0:1787560557.776349:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815573888 00000100:00100000:1.0:1787560557.776352:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815574144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560557.776380:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787560557.776381:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815574144:12345-0@lo:400:kworker.0 Request processed in 30us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560557.776386:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787560557.776387:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815573888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560557.776395:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787560557.776401:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815574400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560557.776437:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815574400:12345-0@lo:400:kworker.0 Request processed in 37us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560557.776437:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815573888:12345-0@lo:400:kworker.0 Request processed in 51us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560557.776445:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787560557.776445:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787560557.776518:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815574144:0@lo:400:kworker.0 00000100:00100000:1.0:1787560557.776538:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815574016:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.776638:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815573888:0@lo:400:kworker.0 00000100:00100000:1.0:1787560557.776643:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815574528 00000100:00100000:1.0:1787560557.776647:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815574528 00000100:00100000:2.0:1787560557.776652:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815574400:0@lo:400:kworker.0 00000100:00100000:3.0:1787560557.776696:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815574272 00000100:00080000:2.0:1787560557.776707:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560557.776714:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815574272 00000100:00080000:2.0:1787560557.776725:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560557.776784:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787560557.776796:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815574528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560557.776822:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787560557.776840:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815574272:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787560557.776913:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560557.776987:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815574272:12345-0@lo:400:kworker.0 Request processed in 153us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560557.776995:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787560557.777535:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1787560557.777544:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1787560557.777569:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815574272:0@lo:400:kworker.0 00000100:00100000:2.0:1787560557.778803:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815574528:12345-0@lo:400:kworker.0 Request processed in 2001us (3240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560557.778818:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787560557.778924:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787560557.778930:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d9bf8a4000, transno 4294967304 00000100:00100000:2.0:1787560557.778956:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815574528:0@lo:400:kworker.0 00000100:00100000:0.0:1787560558.293563:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560558.299235:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815574656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560558.299312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560558.306462:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815574656 00000100:00100000:3.0:1787560558.306477:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815574656 00000100:00100000:3.0:1787560558.306537:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787560558.306547:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815574656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560558.306586:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560558.306660:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815574656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (7348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560558.306668:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787560558.306733:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815574656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787560558.355106:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787560558.927129:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560558.927139:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560558.927222:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787560558.927234:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787560559.210825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560559.216934:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788301184 00000100:00100000:1.0:1787560559.216958:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788301184 00000100:00100000:1.0:1787560559.217165:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 135 00000100:00100000:1.0:1787560559.217183:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:10216:x1874392788301184:12345-192.168.201.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787560559.217329:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:10216:x1874392788301184:12345-192.168.201.56@tcp:60:lhsmtool_posix.0 Request processed in 155us (6518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560559.217335:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 135 00000100:00100000:3.0:1787560559.220757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560559.220912:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788301440 00000100:00100000:2.0:1787560559.220927:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788301440 00000100:00100000:2.0:1787560559.221016:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:2.0:1787560559.221028:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:10216:x1874392788301440:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787560559.221716:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:10216:x1874392788301440:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 688us (967us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787560559.221724:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00080000:0.0:1787560559.224298:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787560559.375588:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560559.644770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560559.644880:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788301568 00000100:00100000:0.0:1787560559.644895:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788301568 00000100:00100000:0.0:1787560559.645013:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 136 00000100:00100000:0.0:1787560559.645026:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:11015:x1874392788301568:12345-192.168.201.56@tcp:101:lsof.0 00010000:00010000:0.0:1787560559.645075:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560559.645106:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673f883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924bc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560559.645195:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560559.645212:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560559.645225:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787560559.645498:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787560559.645741:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787560559.646087:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560559.646221:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560559.646262:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673f883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924bc expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560559.646628:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924bc expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560559.646640:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:0.0:1787560559.646644:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560559.646649:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101400, rc 0) 00000100:00100000:0.0:1787560559.646791:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:11015:x1874392788301568:12345-192.168.201.56@tcp:101:lsof.0 Request processed in 1766us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560559.646800:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 136 00010000:00010000:2.0:1787560560.399310:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560560.565465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560560.565531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560560.565579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560560.565600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560560.565635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560560.565675:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788301952 00000100:00100000:3.0:1787560560.565687:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788301952 00000100:00100000:3.0:1787560560.565789:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788302080 00000100:00100000:3.0:1787560560.565793:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788302080 00000100:00100000:3.0:1787560560.565822:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:3.0:1787560560.565833:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788301952:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560560.567655:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788301952:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 1810us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560560.567672:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:3.0:1787560560.567717:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:3.0:1787560560.567731:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788302080:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560560.568290:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788301696 00000100:00100000:0.0:1787560560.568301:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788301696 00000100:00100000:0.0:1787560560.568351:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 292 00000100:00100000:0.0:1787560560.568358:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788301696:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560560.568390:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788301696:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 34us (2945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560560.568397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 292 00000100:00080000:0.0:1787560560.568470:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560560.568477:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560560.568491:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788302208 00000100:00100000:0.0:1787560560.568496:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788302208 00000100:00100000:0.0:1787560560.568522:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788301824 00000100:00100000:0.0:1787560560.568538:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788301824 00000100:00100000:0.0:1787560560.568565:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 147 00000100:00100000:0.0:1787560560.568572:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2344:x1874392788302208:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560560.568617:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2344:x1874392788302208:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 45us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560560.568626:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 147 00000100:00100000:0.0:1787560560.568639:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 148 00000100:00100000:0.0:1787560560.568645:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:2344:x1874392788301824:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560560.568674:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:2344:x1874392788301824:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 29us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560560.568680:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 148 00000100:00100000:3.0:1787560560.570582:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788302080:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 2842us (4933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560560.570599:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:2.0:1787560560.850956:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560560.851023:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b393a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815574784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560560.851118:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560560.851501:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815574784 00000100:00100000:0.0:1787560560.851512:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815574784 00000100:00100000:0.0:1787560560.851617:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787560560.851629:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815574784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560560.851707:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560560.851772:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815574784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560560.851779:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787560560.852037:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560560.852090:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b393a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815574784:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1787560560.927899:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1787560560.927928:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787560560.927929:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787560560.927941:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787560561.424347:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560562.447236:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560562.895739:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815574912:0@lo:400:kworker.0 00000100:00100000:2.0:1787560562.895933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560562.896002:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815575424:0@lo:400:kworker.0 00000100:00100000:2.0:1787560562.896035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560562.896068:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560562.896074:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815575296:0@lo:400:kworker.0 00000100:00100000:2.0:1787560562.896106:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560562.896138:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815575168:0@lo:400:kworker.0 00000100:00100000:2.0:1787560562.896185:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560562.896206:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787560562.896212:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815575040:0@lo:400:kworker.0 00000100:00100000:2.0:1787560562.896238:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560562.896261:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815575552:0@lo:400:kworker.0 00000100:00100000:2.0:1787560562.896298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560562.896333:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815575424 00000100:00100000:2.0:1787560562.896343:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815575424 00000100:00100000:2.0:1787560562.896415:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815575168 00000100:00100000:2.0:1787560562.896418:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815575168 00000100:00100000:1.0:1787560562.897198:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815575040 00000100:00100000:1.0:1787560562.897206:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815575040 00000100:00100000:1.0:1787560562.897246:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787560562.897258:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815575424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.897357:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815575424:12345-0@lo:400:kworker.0 Request processed in 100us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560562.897364:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787560562.897385:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787560562.897397:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815575168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.897435:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815575168:12345-0@lo:400:kworker.0 Request processed in 40us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560562.897755:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815574912 00000100:00100000:3.0:1787560562.897762:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815574912 00000100:00100000:3.0:1787560562.897800:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787560562.897807:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815574912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560562.897919:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815574912:12345-0@lo:400:kworker.0 Request processed in 112us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560562.897938:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787560562.898011:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787560562.898020:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815575040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560562.898055:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815575040:12345-0@lo:400:kworker.0 Request processed in 37us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560562.898061:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787560562.898119:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815575040:0@lo:400:kworker.0 00000100:00100000:3.0:1787560562.898134:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815575168:0@lo:400:kworker.0 00000100:00080000:3.0:1787560562.898175:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560562.898320:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787560562.898354:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815574912:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.898367:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815575424:0@lo:400:kworker.0 00000100:00100000:0.0:1787560562.898528:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815575296 00000100:00100000:0.0:1787560562.898535:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815575296 00000100:00100000:0.0:1787560562.898600:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815575552 00000100:00100000:0.0:1787560562.898604:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815575552 00000100:00100000:0.0:1787560562.898642:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787560562.898652:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815575296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560562.898703:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815575296:12345-0@lo:400:kworker.0 Request processed in 54us (2596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560562.898710:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787560562.898728:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787560562.898735:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815575552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560562.898771:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815575552:12345-0@lo:400:kworker.0 Request processed in 37us (2485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560562.898778:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787560562.898839:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815575552:0@lo:400:kworker.0 00000100:00100000:1.0:1787560562.900079:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815575296:0@lo:400:kworker.0 00000100:00080000:3.0:1787560562.900359:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560562.900367:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560563.407225:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815575680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560563.407343:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560563.407642:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815575680 00000100:00100000:3.0:1787560563.407654:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815575680 00000100:00100000:3.0:1787560563.407730:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787560563.407740:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815575680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560563.407787:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560563.407839:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815575680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560563.407876:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787560563.408244:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815575680:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560563.472385:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787560564.142000:0:12305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 04:36:02 (1787560562) 00010000:00010000:0.0:1787560564.495459:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560565.520282:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560565.618472:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560565.619237:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788302464 00000100:00100000:3.0:1787560565.619252:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788302464 00000100:00100000:3.0:1787560565.619359:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:3.0:1787560565.619393:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:11280:x1874392788302464:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560565.619421:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560565.619458:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f891 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924c3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.619559:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f898 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.619593:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f898 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.619608:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f898 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.619626:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f89f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.619633:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f89f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.619639:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f89f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787560565.620366:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787560565.627138:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673f8a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627172:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673f8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627187:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673f8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560565.627218:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787560565.627477:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f898 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627487:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f898 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627496:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f898 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627503:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebc00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560565.627508:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f898 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627516:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f898 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627533:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d987d52100) 00010000:00010000:3.0:1787560565.627536:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560565.627543:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f898 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627550:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f898 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627571:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f89f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627578:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f89f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627596:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f89f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627602:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560565.627605:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f89f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627612:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f89f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627621:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93d9a1269900) 00010000:00010000:3.0:1787560565.627624:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560565.627628:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f89f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.627635:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f89f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.628288:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f891 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924c3 expref: 16 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.628308:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673f8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924c3 expref: 15 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560565.628317:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:3.0:1787560565.628320:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560565.628324:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb200, rc 0) 00000100:00100000:3.0:1787560565.628425:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:11280:x1874392788302464:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 9033us (9965us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787560565.628445:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 137 00000100:00100000:2.0:1787560565.650305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560565.650507:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560565.650994:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788302720 00000100:00100000:0.0:1787560565.651008:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788302720 00000100:00100000:0.0:1787560565.651096:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:0.0:1787560565.651107:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:2345:x1874392788302720:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560565.651128:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560565.651157:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673f8a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924c3 expref: 15 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560565.651185:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:0.0:1787560565.651190:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560565.651278:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:2345:x1874392788302720:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 172us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560565.651286:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:3.0:1787560565.658092:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788302592 00000100:00100000:3.0:1787560565.658117:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788302592 00000100:00100000:0.0:1787560565.662225:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:0.0:1787560565.662258:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:11280:x1874392788302592:12345-192.168.201.56@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787560565.662546:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:11280:x1874392788302592:12345-192.168.201.56@tcp:59:lhsmtool_posix.0 Request processed in 304us (12037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560565.662555:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 138 00000100:00100000:2.0:1787560565.686800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560565.686991:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788302848 00000100:00100000:0.0:1787560565.687005:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788302848 00000100:00100000:0.0:1787560565.687077:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 294 00000100:00100000:0.0:1787560565.687088:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788302848:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560565.688278:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788302848:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 1180us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560565.688310:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 294 00000100:00100000:2.0:1787560565.689339:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560565.689461:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560565.690074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560565.694111:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788303232 00000100:00100000:1.0:1787560565.694136:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788303232 00000100:00100000:1.0:1787560565.694277:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 152 00000100:00100000:1.0:1787560565.694291:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2344:x1874392788303232:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560565.694436:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2344:x1874392788303232:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 138us (4354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560565.694446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 152 00000100:00080000:2.0:1787560565.697034:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560565.699746:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788303104 00000100:00100000:0.0:1787560565.699770:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788303104 00000100:00100000:0.0:1787560565.700130:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788302976 00000100:00100000:0.0:1787560565.700135:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788302976 00000100:00100000:3.0:1787560565.700515:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00100000:3.0:1787560565.700530:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788303104:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560565.700632:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788303104:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 106us (11301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560565.700641:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00080000:2.0:1787560565.702357:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560565.702511:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560565.702968:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 88 00000100:00100000:0.0:1787560565.702991:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788302976:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560565.703118:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2344:x1874392788302976:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 137us (13656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560565.703127:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 88 00000100:00100000:1.0:1787560565.967568:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815575808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560565.969506:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560565.969645:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815575808 00000100:00100000:1.0:1787560565.970448:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815575808 00000100:00100000:1.0:1787560565.970541:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787560565.970553:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815575808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560565.970601:0:6686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560565.970700:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815575808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560565.970709:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787560565.971935:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560565.972034:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815575808:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787560566.056535:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:0.0:1787560566.098804:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560566.098813:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560566.099428:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787560566.099443:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787560566.543104:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560567.567888:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560567.706399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560567.707136:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788303360 00000100:00100000:2.0:1787560567.707150:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788303360 00000100:00100000:2.0:1787560567.707236:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 139 00000100:00100000:2.0:1787560567.707250:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:11323:x1874392788303360:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560567.707274:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560567.707302:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f8b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924ca expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707376:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f8bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707392:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f8bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707403:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f8bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707419:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f8c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707427:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707433:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707700:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f8bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707707:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f8bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707724:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f8bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707730:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560567.707734:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f8bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707742:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f8bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707754:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:2.0:1787560567.707757:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560567.707760:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f8bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707766:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673f8bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707777:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707782:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f8c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707787:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707792:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560567.707795:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707810:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f8c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707818:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93d987fffa00) 00010000:00010000:2.0:1787560567.707820:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560567.707823:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f8c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707828:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673f8c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707894:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f8b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ca expref: 14 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707905:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:2.0:1787560567.707907:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560567.707911:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673f8b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ca expref: 14 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.707920:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710800, rc 0) 00000100:00100000:2.0:1787560567.707984:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:11323:x1874392788303360:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 738us (1597us total) trans 0 rc 301/301 00000100:00100000:2.0:1787560567.707992:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 139 00000100:00080000:3.0:1787560567.711147:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560567.711461:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560567.711535:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788303616 00000100:00100000:0.0:1787560567.711545:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788303616 00000100:00100000:0.0:1787560567.711604:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 140 00000100:00100000:0.0:1787560567.711616:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:11323:x1874392788303616:12345-192.168.201.56@tcp:36:lfs.0 00010000:00010000:0.0:1787560567.711675:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560567.711702:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673f232 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92303 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.711720:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:0.0:1787560567.711725:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560567.712275:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.712298:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924bc expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.712307:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.712344:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924bc expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.712358:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924bc expref: 5 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560567.712373:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3938000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815575936:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560567.712509:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560567.717202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560567.717237:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788303744 00000100:00100000:2.0:1787560567.717247:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788303744 00010000:00010000:2.0:1787560567.717300:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924bc expref: 6 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560567.717345:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:2.0:1787560567.717356:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2342:x1874392788303744:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560567.717372:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560567.717379:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924bc expref: 6 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.717393:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924bc expref: 6 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.717415:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:2.0:1787560567.717420:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.717429:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.717437:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.717458:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560567.717510:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2342:x1874392788303744:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 156us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560567.717517:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00080000:2.0:1787560567.717542:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787560567.720287:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f88a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924bc expref: 5 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560567.720312:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3938000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815575936:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560567.720338:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.720349:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.720355:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.720385:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.720413:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.720424:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560567.721602:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787560567.721616:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.721625:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.721633:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.721638:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560567.721643:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.721650:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.721666:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d987d52f00) 00010000:00010000:0.0:1787560567.721669:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560567.721674:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.721680:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f8c9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560567.721708:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c54845f reply state 00000000a281d340 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560567.721718:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560567.721815:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:11323:x1874392788303616:12345-192.168.201.56@tcp:36:lfs.0 Request processed in 10199us (10355us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787560567.721825:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 140 00010000:00010000:1.0:1787560567.735228:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.735246:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.735254:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.735261:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560567.735266:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.735274:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.735290:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93d987fb3900) 00010000:00010000:1.0:1787560567.735293:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560567.735298:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.735304:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f8d0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560567.816466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560567.816511:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788303872 00000100:00100000:3.0:1787560567.816521:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788303872 00000100:00100000:3.0:1787560567.816576:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 141 00000100:00100000:3.0:1787560567.816587:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:11331:x1874392788303872:12345-192.168.201.56@tcp:101:lctl.0 00010000:00010000:3.0:1787560567.816613:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560567.816635:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f8d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560567.816705:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f8de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560567.816720:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560567.816731:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560567.816803:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787560567.816808:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560567.816837:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f8de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560567.816890:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673f8d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924d1 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560567.816908:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f8de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924d1 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560567.816915:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:3.0:1787560567.816918:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560567.816921:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea000, rc 0) 00000100:00100000:3.0:1787560567.816975:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:11331:x1874392788303872:12345-192.168.201.56@tcp:101:lctl.0 Request processed in 390us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560567.816982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 141 00000100:00100000:2.0:1787560567.879775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560567.880146:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788304000 00000100:00100000:1.0:1787560567.880168:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788304000 00000100:00100000:1.0:1787560567.880574:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 142 00000100:00100000:1.0:1787560567.880591:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+14:11337:x1874392788304000:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1787560567.880612:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560567.880645:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f8e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924d8 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.880712:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f8ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.880727:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f8ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.880737:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f8ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.880754:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f8f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.880762:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.880769:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.880946:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f8fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.880956:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f8fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.880963:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f8fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560567.880995:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787560567.881000:0:11858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560567.881025:0:11858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f8fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881057:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f8ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881065:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f8ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881072:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f8ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881079:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560567.881084:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f8ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881092:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f8ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881105:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:1.0:1787560567.881108:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560567.881112:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f8ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881118:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f8ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881130:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881136:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f8f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881142:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f8f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881165:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560567.881169:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f8f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881175:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f8f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881183:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff93d995c27200) 00010000:00010000:1.0:1787560567.881185:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560567.881188:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f8f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881193:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f8f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881224:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673f8e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924d8 expref: 16 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881237:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f8fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924d8 expref: 15 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560567.881244:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:1.0:1787560567.881247:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787560567.881249:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260600, rc 0) 00000100:00100000:1.0:1787560567.881320:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:11337:x1874392788304000:12345-192.168.201.56@tcp:101:bash.0 Request processed in 734us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560567.882296:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 142 00000100:00100000:2.0:1787560567.892601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560567.892739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788304256 00000100:00100000:0.0:1787560567.892750:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788304256 00000100:00100000:0.0:1787560567.892871:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 143 00000100:00100000:0.0:1787560567.892882:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+15:11337:x1874392788304256:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560567.892903:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560567.892922:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f901 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924df expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893074:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f908 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893088:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f908 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893109:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f908 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893167:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893176:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893201:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787560567.893721:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787560567.893912:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893922:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893930:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893964:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f908 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893971:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f908 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893978:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f908 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893983:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560567.893988:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f908 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.893995:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f908 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.894006:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560567.894009:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560567.894020:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f908 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.894027:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f908 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560567.894041:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a8c4d1f reply state 000000005d75146d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560567.894051:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787560567.894082:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673f901 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924df expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.894096:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924df expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.894104:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:0.0:1787560567.894106:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560567.894109:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100c00, rc 0) 00000100:00100000:0.0:1787560567.894175:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+18:11337:x1874392788304256:12345-192.168.201.56@tcp:101:bash.0 Request processed in 1294us (1583us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787560567.894182:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 143 00010000:00010000:2.0:1787560567.898982:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.899027:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.899042:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.899049:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560567.899054:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.899063:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.899080:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fb3a00) 00010000:00010000:2.0:1787560567.899092:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560567.899097:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560567.899105:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f90f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560567.899731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560567.903346:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788304384 00000100:00100000:3.0:1787560567.903362:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788304384 00000100:00100000:3.0:1787560567.903453:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:3.0:1787560567.903464:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2345:x1874392788304384:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1787560567.903483:0:8101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560567.903504:0:8101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000967fbe2e/0xe34191b05673f924 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924e6 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560567.903531:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560567.903550:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1787560567.903569:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560567.903579:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000967fbe2e/0xe34191b05673f924 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924e6 expref: 6 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560567.903598:0:8101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000967fbe2e/0xe34191b05673f924 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924e6 expref: 6 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560567.903612:0:8101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb400, rc 0) 00000100:00100000:3.0:1787560567.903675:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788304384:12345-192.168.201.56@tcp:101:bash.0 Request processed in 213us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560567.903683:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00080000:2.0:1787560567.903870:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560567.910281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560567.911788:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788304512 00000100:00100000:0.0:1787560567.911800:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788304512 00000100:00100000:0.0:1787560567.911889:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:0.0:1787560567.911900:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:11337:x1874392788304512:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560567.911918:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560567.911936:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924ed expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.911984:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000967fbe2e/0xe34191b05673f924 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924e6 expref: 7 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.911992:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560567.911996:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560567.912001:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.912056:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000967fbe2e/0xe34191b05673f924 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924e6 expref: 7 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.912071:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000967fbe2e/0xe34191b05673f924 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924e6 expref: 7 pid: 8101 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560567.912095:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1874392815576064:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560567.912194:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560567.915570:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6684:1874392815576064:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560567.915609:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.915630:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101800, rc 0) 00000100:00100000:0.0:1787560567.915691:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:11337:x1874392788304512:12345-192.168.201.56@tcp:101:bash.0 Request processed in 3792us (5419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560567.915701:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:2.0:1787560567.915900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560567.917105:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788304640 00000100:00100000:0.0:1787560567.917117:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788304640 00010000:00010000:0.0:1787560567.917160:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000967fbe2e/0xe34191b05673f924 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924e6 expref: 7 pid: 8101 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560567.917203:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:0.0:1787560567.917213:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2343:x1874392788304640:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560567.917228:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560567.917254:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000967fbe2e/0xe34191b05673f924 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924e6 expref: 7 pid: 8101 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.917269:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000967fbe2e/0xe34191b05673f924 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924e6 expref: 7 pid: 8101 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.917290:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000967fbe2e/0xe34191b05673f924 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924e6 expref: 7 pid: 8101 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.917308:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560567.917313:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560567.917321:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.917331:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560567.917367:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560567.917391:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1874392815576192:192.168.201.56@tcp:105: 00000100:00100000:0.0:1787560567.917472:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560567.924540:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3938000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1874392815576192:192.168.201.56@tcp:105: 00010000:00010000:0.0:1787560567.924569:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560567.924630:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788304640:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 7417us (8729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560567.924643:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:3.0:1787560567.926309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560567.926413:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788304896 00000100:00100000:0.0:1787560567.926428:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788304896 00000100:00100000:0.0:1787560567.926501:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:0.0:1787560567.926513:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:11337:x1874392788304896:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:2.0:1787560567.936438:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+18:11337:x1874392788304896:12345-192.168.201.56@tcp:35:bash.0 Request processed in 9913us (10130us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787560567.936454:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:1.0:1787560568.015240:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815576576:0@lo:400:kworker.0 00000100:00100000:3.0:1787560568.015274:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815576704:0@lo:400:kworker.0 00000100:00100000:1.0:1787560568.015323:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560568.015398:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815576448:0@lo:400:kworker.0 00000100:00100000:2.0:1787560568.015665:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815576320:0@lo:400:kworker.0 00000100:00100000:3.0:1787560568.018019:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560568.019056:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815576704 00000100:00100000:3.0:1787560568.019072:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815576704 00000100:00100000:0.0:1787560568.019531:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560568.019587:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815576960:0@lo:400:kworker.0 00000100:00100000:0.0:1787560568.019630:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560568.019721:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815576576 00000100:00100000:0.0:1787560568.019729:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815576576 00000100:00100000:0.0:1787560568.019777:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815576448 00000100:00100000:0.0:1787560568.019779:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815576448 00000100:00100000:0.0:1787560568.019802:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787560568.019811:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815576576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560568.019891:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815576576:12345-0@lo:400:kworker.0 Request processed in 80us (4570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560568.019898:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787560568.019928:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787560568.019934:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815576448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560568.019963:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815576448:12345-0@lo:400:kworker.0 Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560568.019968:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787560568.020338:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815576448:0@lo:400:kworker.0 00000100:00100000:0.0:1787560568.020394:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815576960 00000100:00100000:0.0:1787560568.020398:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815576960 00000100:00100000:0.0:1787560568.020430:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560568.020437:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815576960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560568.020479:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815576960:12345-0@lo:400:kworker.0 Request processed in 42us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560568.020485:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560568.020514:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815576960:0@lo:400:kworker.0 00000100:00080000:2.0:1787560568.020611:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560568.020621:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560568.020623:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560568.020651:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560568.020689:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815576832:0@lo:400:kworker.0 00000100:00100000:2.0:1787560568.020715:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560568.020752:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815576832 00000100:00100000:2.0:1787560568.020756:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815576832 00000100:00100000:2.0:1787560568.020787:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787560568.020794:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815576832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560568.020826:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815576832:12345-0@lo:400:kworker.0 Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560568.020832:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1787560568.020873:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560568.020891:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815576832:0@lo:400:kworker.0 00000100:00100000:0.0:1787560568.020974:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815576320 00000100:00100000:0.0:1787560568.020979:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815576320 00000100:00100000:0.0:1787560568.021227:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787560568.021238:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815576320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560568.021313:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787560568.021313:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815576320:12345-0@lo:400:kworker.0 Request processed in 66us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560568.021330:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787560568.021346:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815576704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560568.021444:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815576704:12345-0@lo:400:kworker.0 Request processed in 113us (3434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560568.021452:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787560568.021524:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815576704:0@lo:400:kworker.0 00000100:00100000:1.0:1787560568.021527:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815576576:0@lo:400:kworker.0 00000100:00100000:3.0:1787560568.021607:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815576320:0@lo:400:kworker.0 00000100:00100000:1.0:1787560568.077619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560568.077688:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788305152 00000100:00100000:0.0:1787560568.077705:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788305152 00000100:00100000:0.0:1787560568.077765:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 144 00000100:00100000:0.0:1787560568.077773:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+18:11347:x1874392788305152:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560568.077793:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560568.077867:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924f4 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560568.077968:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787560568.078072:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f932 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924f4 expref: 20 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.078086:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:0.0:1787560568.078088:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560568.078093:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924f4 expref: 20 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.078109:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101200, rc 0) 00000100:00100000:0.0:1787560568.078181:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:11347:x1874392788305152:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 409us (581us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787560568.078187:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 144 00000100:00100000:0.0:1787560568.083752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.083884:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788305408 00000100:00100000:1.0:1787560568.083895:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788305408 00000100:00100000:1.0:1787560568.083959:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:1.0:1787560568.083970:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:11347:x1874392788305408:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:1.0:1787560568.084235:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:11347:x1874392788305408:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 267us (492us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787560568.084243:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 37 00000040:00080000:0.0:1787560568.143158:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560568.143169:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560568.143409:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787560568.143420:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787560568.157741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560568.157881:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788305536 00000100:00100000:2.0:1787560568.157892:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788305536 00000100:00100000:2.0:1787560568.157956:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 145 00000100:00100000:2.0:1787560568.157968:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:11353:x1874392788305536:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560568.157995:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560568.158017:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf924fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.158096:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f947 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.158110:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.158121:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560568.158206:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787560568.158210:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560568.158231:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.158269:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924fb expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.158292:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924fb expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.158300:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:2.0:1787560568.158303:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560568.158306:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711a00, rc 0) 00000100:00100000:2.0:1787560568.158357:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:11353:x1874392788305536:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 392us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560568.158364:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 145 00000100:00100000:3.0:1787560568.179539:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.179666:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788305792 00000100:00100000:1.0:1787560568.179677:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788305792 00000100:00100000:1.0:1787560568.179749:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 146 00000100:00100000:1.0:1787560568.179760:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:11353:x1874392788305792:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560568.179782:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560568.179803:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f94e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92502 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.179960:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f955 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.179974:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.179986:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560568.180021:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787560568.180382:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673f94e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92502 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.180400:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f955 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92502 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.180409:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:1.0:1787560568.180411:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560568.180415:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260400, rc 0) 00000100:00100000:1.0:1787560568.180483:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:11353:x1874392788305792:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 725us (955us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787560568.180492:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 146 00000100:00100000:0.0:1787560568.197095:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560568.197152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560568.197315:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788306176 00000100:00100000:3.0:1787560568.197335:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788306176 00000100:00100000:2.0:1787560568.197399:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788306048 00000100:00100000:2.0:1787560568.197415:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788306048 00000100:00100000:3.0:1787560568.197463:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:3.0:1787560568.197480:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:2345:x1874392788306176:12345-192.168.201.56@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787560568.197497:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 147 00010000:00010000:3.0:1787560568.197503:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787560568.197515:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:11353:x1874392788306048:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560568.197546:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673f955 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92502 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.197549:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560568.197574:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f963 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92509 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.197578:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:3.0:1787560568.197592:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560568.197685:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:2345:x1874392788306176:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 208us (530us total) trans 0 rc 0/0 00010000:00010000:2.0:1787560568.197692:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f96a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560568.197694:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00010000:00010000:2.0:1787560568.197733:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f96a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.197746:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f96a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560568.197761:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787560568.197968:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710400/0xe34191b05673f963 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92509 expref: 25 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.197997:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f96a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92509 expref: 24 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.198006:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:2.0:1787560568.198009:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787560568.198013:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711e00, rc 0) 00000100:00100000:3.0:1787560568.198254:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:11353:x1874392788306048:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 742us (1166us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787560568.198264:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 147 00000100:00100000:0.0:1787560568.208129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560568.208768:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788306304 00000100:00100000:2.0:1787560568.208784:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788306304 00000100:00100000:2.0:1787560568.209067:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:2.0:1787560568.209081:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788306304:12345-192.168.201.56@tcp:1:lfs.0 00010000:00010000:2.0:1787560568.209167:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.209194:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.209205:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560568.209228:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560568.209234:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.209455:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.209478:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 6 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560568.209497:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1874392815577088:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560568.209630:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1787560568.212635:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1874392815577088:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560568.212689:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560568.215618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.215733:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788306432 00000100:00100000:1.0:1787560568.215748:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788306432 00002000:00100000:1.0:1787560568.215842:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93d9bab95c00 x1874392788306432/t0(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:684/0 lens 504/0 e 0 to 0 dl 1787560579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787560568.215894:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9bab95c00 with x1874392788306432 ext(0->12) 00010000:00010000:1.0:1787560568.215905:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 7 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.215926:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 7 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560568.215934:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93d9bab95c00 00000100:00100000:1.0:1787560568.215975:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:1.0:1787560568.216007:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788306432:12345-192.168.201.56@tcp:4:lfs.0 00000100:00100000:1.0:1787560568.217475:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2342:x1874392788306432:12345-192.168.201.56@tcp:4:lfs.0 Request processed in 1458us (1858us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787560568.217491:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 2 00002000:00100000:1.0:1787560568.217504:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff93d9bab95c00 x1874392788306432/t4294967305(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:684/0 lens 504/448 e 0 to 0 dl 1787560579 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787560568.217516:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9bab95c00 with x1874392788306432 ext(0->12) 00010000:00010000:1.0:1787560568.217527:0:6689:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.217548:0:6689:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560568.217556:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93d9bab95c00 00000100:00100000:2.0:1787560568.220894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560568.221052:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788306560 00000100:00100000:3.0:1787560568.221065:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788306560 00010000:00010000:3.0:1787560568.221130:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560568.221182:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:3.0:1787560568.221193:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2343:x1874392788306560:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560568.221234:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787560568.221263:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787560568.221266:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787560568 00002000:00010000:3.0:1787560568.221268:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787560568 00002000:00010000:3.0:1787560568.221271:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787560568 00010000:00010000:3.0:1787560568.221278:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.221306:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.221334:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e665523/0xe34191b05673f92b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ed expref: 9 pid: 6684 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.221355:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560568.221360:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560568.221367:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.221378:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.221416:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560568.221500:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788306560:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 308us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560568.221509:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 63 00010000:00010000:2.0:1787560568.222281:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.222369:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.222411:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.222421:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.222431:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.222454:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560568.222459:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.222470:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.222487:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560568.222496:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043ba6e7d/0xe34191b05673f978 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560568.222597:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788306304:12345-192.168.201.56@tcp:1:lfs.0 Request processed in 13515us (14483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560568.222606:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:2.0:1787560568.226813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.227245:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788306816 00000100:00100000:1.0:1787560568.227268:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788306816 00000100:00100000:1.0:1787560568.227349:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:1.0:1787560568.227360:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae747850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:11353:x1874392788306816:12345-192.168.201.56@tcp:35:lfs.0 00000004:00010000:1.0:1787560568.227446:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f96a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92509 expref: 24 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560568.227761:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787560568.227800:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787560568.228560:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787560568.228639:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.228672:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924df expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.228681:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.228738:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924df expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.228758:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924df expref: 28 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560568.228778:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3952a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1874392815577216:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560568.228945:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d882e90180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560568.233087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560568.233523:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788306944 00000100:00100000:3.0:1787560568.233536:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788306944 00010000:00010000:3.0:1787560568.233588:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924df expref: 29 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560568.233638:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:3.0:1787560568.233649:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9a5e11450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:2342:x1874392788306944:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560568.233667:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560568.233675:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924df expref: 29 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.233691:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924df expref: 29 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.233718:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:3.0:1787560568.233724:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.233735:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.233743:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.233762:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560568.233890:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9a5e11450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:2342:x1874392788306944:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 241us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560568.233897:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 64 00010000:00010000:1.0:1787560568.235080:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673f916 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924df expref: 28 pid: 5837 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560568.235121:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3952a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1874392815577216:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560568.235167:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.235178:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.235184:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560568.235777:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787560568.236721:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787560568.236977:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3952a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815577344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787560568.237063:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560568.237235:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d882e90c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560568.237497:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815577344 00000100:00100000:0.0:1787560568.237509:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815577344 00000100:00100000:0.0:1787560568.237582:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560568.237593:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1874392815577344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787560568.237819:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1874392815577344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 227us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560568.237828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560568.238064:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3952a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815577344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787560568.241881:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787560568.242057:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3952a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815577472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787560568.242167:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560568.242214:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d882e90180 going to sleep for 11 seconds 00000100:00100000:3.0:1787560568.242437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815577472 00000100:00100000:3.0:1787560568.242464:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815577472 00000100:00100000:3.0:1787560568.242535:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560568.242547:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874392815577472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787560568.242819:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1874392815577472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 273us (650us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787560568.242829:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560568.243034:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3952a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815577472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787560568.243118:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787560568.243169:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.243181:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.243190:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.243197:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560568.243203:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.243212:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.243234:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:1.0:1787560568.243237:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787560568.243253:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.243259:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f97f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787560568.243558:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787560568.243689:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1787560568.243704:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396996855902ns, next at 397996853579ns, rc = 0 00000001:00080000:1.0:1787560568.243712:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787560568.243752:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:1.0:1787560568.243755:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787560568.243764:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673f96a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92509 expref: 32 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560568.243961:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae747850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:11353:x1874392788306816:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 16601us (17173us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787560568.243971:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00000020:00080000:1.0:1787560568.243977:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787560568.251690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.251791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788307072 00000100:00100000:1.0:1787560568.251813:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788307072 00000100:00100000:1.0:1787560568.251942:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 148 00000100:00100000:1.0:1787560568.251956:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:11353:x1874392788307072:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560568.252000:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560568.252032:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f986 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92510 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.252141:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92510 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.252188:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92510 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.252215:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:1.0:1787560568.252219:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560568.252224:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260200, rc 0) 00000100:00100000:1.0:1787560568.252317:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:11353:x1874392788307072:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 364us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560568.252326:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 148 00000100:00100000:3.0:1787560568.256560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560568.256681:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788307328 00000100:00100000:2.0:1787560568.256696:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788307328 00000100:00100000:1.0:1787560568.256909:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:1.0:1787560568.256934:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:11353:x1874392788307328:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:1.0:1787560568.257486:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+33:11353:x1874392788307328:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 561us (939us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787560568.257496:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:2.0:1787560568.359922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.360127:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788307584 00000100:00100000:1.0:1787560568.360141:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788307584 00000100:00100000:1.0:1787560568.360230:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 149 00000100:00100000:1.0:1787560568.360244:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+33:11363:x1874392788307584:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560568.360298:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560568.360331:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f98d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92517 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560568.360502:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787560568.360675:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f98d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92517 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.360729:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:1.0:1787560568.360733:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560568.360740:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f98d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92517 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.360757:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260800, rc 0) 00000100:00100000:1.0:1787560568.360900:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:11363:x1874392788307584:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 659us (1072us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787560568.360909:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 149 00000100:00100000:0.0:1787560568.367068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.367185:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788307712 00000100:00100000:1.0:1787560568.367200:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788307712 00000100:00100000:1.0:1787560568.367305:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 150 00000100:00100000:1.0:1787560568.367319:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:11363:x1874392788307712:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:1.0:1787560568.367424:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f99b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367444:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f99b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367457:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f99b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367473:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367480:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367507:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367627:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367634:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367642:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560568.367694:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367710:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f99b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367717:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f99b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367724:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f99b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367731:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560568.367736:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f99b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367764:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f99b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367780:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:1.0:1787560568.367789:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560568.367795:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f99b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367802:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673f99b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367828:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367900:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367907:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367913:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560568.367916:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367923:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367937:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d995c27b00) 00010000:00010000:1.0:1787560568.367940:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560568.367942:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367948:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367971:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.367990:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.368063:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.368069:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560568.368073:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.368079:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.368091:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:1.0:1787560568.368094:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560568.368097:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.368103:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560568.368235:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:11363:x1874392788307712:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 912us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560568.368245:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 150 00000100:00100000:0.0:1787560568.373160:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.373250:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788307968 00000100:00100000:1.0:1787560568.373275:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788307968 00000100:00100000:1.0:1787560568.373372:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 40 00000100:00100000:1.0:1787560568.373385:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:11363:x1874392788307968:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:1.0:1787560568.373757:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+35:11363:x1874392788307968:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 374us (624us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787560568.373785:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 40 00000100:00100000:3.0:1787560568.426887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560568.427081:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788308224 00000100:00100000:0.0:1787560568.427109:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788308224 00000100:00100000:0.0:1787560568.427274:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 151 00000100:00100000:0.0:1787560568.427532:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+35:11366:x1874392788308224:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560568.427570:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560568.427600:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f9b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9251e expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.427709:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f9b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.427726:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f9b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.427739:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f9b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.427755:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f9be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.427763:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.427770:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.428031:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.428041:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.428049:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560568.428062:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787560568.428439:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f9b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.428448:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f9b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.428454:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f9b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.428461:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560568.430480:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f9b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430505:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f9b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430531:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560568.430535:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560568.430542:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f9b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430575:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673f9b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430602:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430608:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f9be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430616:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f9be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430622:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560568.430625:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f9be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430631:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f9be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430639:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fb3600) 00010000:00010000:0.0:1787560568.430642:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560568.430645:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f9be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430650:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673f9be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430740:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673f9b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9251e expref: 38 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430770:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9251e expref: 37 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.430778:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:0.0:1787560568.430780:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560568.430783:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101c00, rc 0) 00000100:00100000:0.0:1787560568.430945:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:11366:x1874392788308224:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 3658us (4117us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787560568.430956:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 151 00000100:00100000:0.0:1787560568.438147:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560568.438401:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788308352 00000100:00100000:3.0:1787560568.438415:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788308352 00000100:00100000:3.0:1787560568.438491:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 152 00000100:00100000:3.0:1787560568.438505:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:11366:x1874392788308352:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:3.0:1787560568.438601:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f9d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.438622:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.438636:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.438670:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.438678:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f9d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.438686:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.438693:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebc00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560568.438717:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.438726:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f9d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.438742:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:3.0:1787560568.438745:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560568.438751:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f9d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.438758:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673f9d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560568.438937:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:11366:x1874392788308352:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 433us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560568.438946:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 152 00000100:00100000:3.0:1787560568.442358:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.442511:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788308608 00000100:00100000:1.0:1787560568.442524:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788308608 00000100:00100000:1.0:1787560568.442602:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00100000:1.0:1787560568.442614:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:11366:x1874392788308608:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:1.0:1787560568.442982:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+38:11366:x1874392788308608:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 368us (637us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787560568.442991:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00100000:1.0:1787560568.529767:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815577600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560568.529920:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560568.530118:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815577600 00000100:00100000:3.0:1787560568.530138:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815577600 00000100:00100000:3.0:1787560568.530207:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787560568.530220:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815577600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560568.530250:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560568.530335:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815577600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560568.530343:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787560568.530564:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815577600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787560568.591241:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560568.709816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.709986:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788308864 00000100:00100000:1.0:1787560568.710000:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788308864 00000100:00100000:1.0:1787560568.710089:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 153 00000100:00100000:1.0:1787560568.710102:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+38:11397:x1874392788308864:12345-192.168.201.56@tcp:101:cat.0 00010000:00010000:1.0:1787560568.710136:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560568.710165:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92525 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.710326:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.710343:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.710356:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560568.710397:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787560568.710570:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673f9da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92525 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.710593:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92525 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.710603:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:1.0:1787560568.710605:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560568.710610:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261800, rc 0) 00000100:00100000:1.0:1787560568.710688:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+40:11397:x1874392788308864:12345-192.168.201.56@tcp:101:cat.0 Request processed in 590us (889us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787560568.710696:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 153 00000100:00100000:0.0:1787560568.715584:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560568.715677:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788308992 00000100:00100000:3.0:1787560568.715690:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788308992 00000100:00100000:3.0:1787560568.715770:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1787560568.715840:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf8a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+40:2344:x1874392788308992:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560568.715924:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560568.715956:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673f9e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92525 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.715977:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:3.0:1787560568.715982:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560568.716053:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf8a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+39:2344:x1874392788308992:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 218us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560568.716060:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1787560568.718718:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.719039:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788309248 00000100:00100000:1.0:1787560568.719052:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788309248 00000100:00100000:1.0:1787560568.719205:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:1.0:1787560568.719219:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+39:11397:x1874392788309248:12345-192.168.201.56@tcp:35:cat.0 00000100:00100000:1.0:1787560568.719573:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+40:11397:x1874392788309248:12345-192.168.201.56@tcp:35:cat.0 Request processed in 357us (868us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787560568.719582:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:1.0:1787560568.785482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560568.785652:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788309504 00000100:00100000:0.0:1787560568.785666:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788309504 00000100:00100000:0.0:1787560568.785799:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 154 00000100:00100000:0.0:1787560568.785813:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+40:11403:x1874392788309504:12345-192.168.201.56@tcp:101:dd.0 00010000:00010000:0.0:1787560568.785896:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560568.785901:0:11858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787560568.785946:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673f947 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924fb expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.785971:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560568.785978:0:11858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560568.785996:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f9ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9252c expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.786749:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.786766:0:11858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9251e expref: 40 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.786787:0:11858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.786842:0:11858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9251e expref: 40 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560568.786915:0:11858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9251e expref: 40 pid: 11858 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560568.786937:0:11858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4227480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815577728:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560568.787061:0:11858:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503180 going to sleep for 11 seconds 00000100:00100000:0.0:1787560568.795633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560568.795733:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788309632 00000100:00100000:3.0:1787560568.795746:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788309632 00010000:00010000:3.0:1787560568.795812:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9251e expref: 41 pid: 11858 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560568.795888:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:3.0:1787560568.795900:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+41:2343:x1874392788309632:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560568.795929:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560568.795937:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9251e expref: 41 pid: 11858 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.795955:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9251e expref: 41 pid: 11858 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.795988:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:3.0:1787560568.795994:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.796023:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.796031:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560568.796055:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560568.796131:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+41:2343:x1874392788309632:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 233us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560568.796140:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 65 00010000:00010000:1.0:1787560568.797564:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673f9c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9251e expref: 40 pid: 11858 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560568.797589:0:11858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4227480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815577728:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560568.797638:0:11858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.797649:0:11858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.797653:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560568.797675:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787560568.798693:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673f9ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9252c expref: 41 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.798721:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9252c expref: 40 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.798731:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:1.0:1787560568.798735:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560568.798739:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100600, rc 0) 00000100:00100000:1.0:1787560568.798883:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+40:11403:x1874392788309504:12345-192.168.201.56@tcp:101:dd.0 Request processed in 13073us (13417us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787560568.798893:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 154 00000100:00100000:0.0:1787560568.811775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560568.811883:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788309888 00000100:00100000:1.0:1787560568.811897:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788309888 00000100:00100000:1.0:1787560568.811989:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 155 00000100:00100000:1.0:1787560568.812003:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+40:11403:x1874392788309888:12345-192.168.201.56@tcp:36:dd.0 00010000:00010000:1.0:1787560568.812491:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.812534:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.812548:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560568.812614:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1787560568.812642:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078665ebb reply state 00000000274b2d56 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560568.812653:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560568.812955:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+43:11403:x1874392788309888:12345-192.168.201.56@tcp:36:dd.0 Request processed in 844us (1086us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787560568.812965:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 155 00000020:00080000:1.0:1787560568.812972:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787560568.818270:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.818297:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.818307:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.818314:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560568.818320:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.818329:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.818385:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:1.0:1787560568.818390:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560568.818396:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560568.818403:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fa04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560569.267762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.269170:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788310016 00000100:00100000:2.0:1787560569.269188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788310016 00000100:00100000:2.0:1787560569.269330:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 156 00000100:00100000:2.0:1787560569.269347:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+42:11417:x1874392788310016:12345-192.168.201.56@tcp:101:stat.0 00010000:00010000:2.0:1787560569.269382:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560569.269411:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673fa0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92533 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787560569.269422:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787560569.269504:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.269520:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.269536:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.269553:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.269561:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.269569:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.269683:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.269693:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9252c expref: 43 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.269700:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.269744:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9252c expref: 43 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.269757:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9252c expref: 43 pid: 11858 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560569.269770:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815577856:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560569.271153:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38fac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560569.274697:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560569.277107:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788310272 00000100:00100000:0.0:1787560569.277131:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788310272 00000100:00100000:0.0:1787560569.277243:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:0.0:1787560569.277258:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+44:5584:x1874392788310272:12345-192.168.201.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787560569.277717:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+45:5584:x1874392788310272:12345-192.168.201.56@tcp:35:ldlm_bl.0 Request processed in 461us (3033us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787560569.277743:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:2.0:1787560569.280937:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815577856:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560569.280992:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560569.281877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560569.282059:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788310400 00000100:00100000:3.0:1787560569.282071:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788310400 00010000:00010000:3.0:1787560569.282120:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9252c expref: 45 pid: 11858 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560569.282167:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:3.0:1787560569.282180:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+45:2345:x1874392788310400:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560569.282199:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560569.282207:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9252c expref: 45 pid: 11858 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.282222:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9252c expref: 45 pid: 11858 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.282249:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100600/0xe34191b05673f9f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9252c expref: 45 pid: 11858 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.282302:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:3.0:1787560569.282308:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.282319:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.282328:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.282418:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560569.282500:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+44:2345:x1874392788310400:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 321us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560569.282508:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 66 00010000:00010000:2.0:1787560569.284967:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.284988:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560569.285572:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787560569.285579:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560569.285624:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285646:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285660:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285690:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285699:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285707:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560569.285713:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285721:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285740:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:2.0:1787560569.285744:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560569.285749:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285755:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285775:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285780:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285786:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285791:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560569.285800:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.285806:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.287179:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fffa00) 00010000:00010000:2.0:1787560569.287191:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560569.287201:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.287333:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.287627:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673fa0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92533 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.287649:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92533 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.287657:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:2.0:1787560569.287660:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560569.287663:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711000, rc 0) 00000100:00100000:2.0:1787560569.288438:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+43:11417:x1874392788310016:12345-192.168.201.56@tcp:101:stat.0 Request processed in 19088us (20684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560569.288450:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 156 00000100:00100000:1.0:1787560569.359843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560569.360000:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788310656 00000100:00100000:0.0:1787560569.360014:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788310656 00000100:00100000:0.0:1787560569.360193:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 157 00000100:00100000:0.0:1787560569.360209:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba33ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+43:11423:x1874392788310656:12345-192.168.201.56@tcp:36:truncate.0 00010000:00010000:0.0:1787560569.360366:0:11858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560569.360404:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fa20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92533 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560569.360429:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:0.0:1787560569.360436:0:11858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560569.360711:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560569.360727:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560569.360739:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787560569.360800:0:11858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787560569.360836:0:11858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5f9de2c reply state 000000005e43ac8a transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560569.360899:0:11858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560569.361034:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba33ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+45:11423:x1874392788310656:12345-192.168.201.56@tcp:36:truncate.0 Request processed in 827us (1217us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787560569.361042:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 157 00000020:00080000:0.0:1787560569.361069:0:11858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787560569.363599:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.363622:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.363653:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.363660:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560569.363666:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.363675:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.363696:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:2.0:1787560569.363699:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560569.363706:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.363712:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fa27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560569.481825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.482005:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788310784 00000100:00100000:2.0:1787560569.482019:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788310784 00000100:00100000:2.0:1787560569.482268:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 158 00000100:00100000:2.0:1787560569.482281:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+44:11437:x1874392788310784:12345-192.168.201.56@tcp:101:stat.0 00010000:00010000:2.0:1787560569.482314:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560569.482343:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9253a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482612:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482629:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482662:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482678:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482686:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482693:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482831:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482840:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482878:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560569.482923:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787560569.482928:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560569.482953:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482968:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482976:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.482994:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483001:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483008:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560569.483012:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483020:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483034:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:2.0:1787560569.483038:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560569.483043:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483050:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483615:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483625:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483632:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483637:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560569.483648:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483655:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483664:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fffa00) 00010000:00010000:2.0:1787560569.483667:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560569.483670:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483675:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483726:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9253a expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483741:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9253a expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.483749:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:2.0:1787560569.483751:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560569.483754:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710000, rc 0) 00000100:00100000:2.0:1787560569.483922:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+45:11437:x1874392788310784:12345-192.168.201.56@tcp:101:stat.0 Request processed in 1643us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560569.483932:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 158 00000100:00100000:3.0:1787560569.565491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.565625:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788311040 00000100:00100000:2.0:1787560569.565639:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788311040 00000100:00100000:2.0:1787560569.565719:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 159 00000100:00100000:2.0:1787560569.565732:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+45:11447:x1874392788311040:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560569.565778:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560569.565817:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92541 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560569.566019:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787560569.566610:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92541 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.566629:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:2.0:1787560569.566632:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560569.566638:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fa4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92541 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.566658:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710200, rc 0) 00000100:00100000:2.0:1787560569.566789:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+46:11447:x1874392788311040:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1058us (1312us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787560569.566798:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 159 00000100:00100000:1.0:1787560569.571714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560569.572056:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788311296 00000100:00100000:0.0:1787560569.572193:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788311296 00000100:00100000:0.0:1787560569.572321:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:0.0:1787560569.572336:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae745c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+46:11447:x1874392788311296:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560569.572698:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae745c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+47:11447:x1874392788311296:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 364us (998us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787560569.572707:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 44 00010000:00010000:1.0:1787560569.619921:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560569.631766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560569.631921:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788311552 00000100:00100000:0.0:1787560569.631934:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788311552 00000100:00100000:0.0:1787560569.632014:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 160 00000100:00100000:0.0:1787560569.632036:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+47:11453:x1874392788311552:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560569.632085:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560569.632113:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101a00/0xe34191b05673fa58 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92548 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560569.632265:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560569.632283:0:11858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9253a expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560569.632294:0:11858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560569.632340:0:11858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9253a expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560569.632356:0:11858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9253a expref: 48 pid: 5838 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560569.632390:0:11858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4224e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815577984:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560569.632517:0:11858:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503180 going to sleep for 11 seconds 00000100:00100000:0.0:1787560569.641462:0:11858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4224e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815577984:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560569.641513:0:11858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560569.647425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560569.647707:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788311680 00000100:00100000:3.0:1787560569.647721:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788311680 00010000:00010000:3.0:1787560569.647776:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9253a expref: 49 pid: 5838 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560569.647836:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 67 00000100:00100000:3.0:1787560569.647892:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+49:2342:x1874392788311680:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560569.647911:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560569.647920:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9253a expref: 49 pid: 5838 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.647936:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9253a expref: 49 pid: 5838 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.647983:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673fa43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9253a expref: 49 pid: 5838 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.648009:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:3.0:1787560569.648014:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.648025:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.648033:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.648206:0:11858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.648215:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560569.648239:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787560569.648459:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101a00/0xe34191b05673fa58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92548 expref: 50 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.648478:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92548 expref: 49 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.648486:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:1.0:1787560569.648496:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560569.648499:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100e00, rc 0) 00010000:00010000:3.0:1787560569.648679:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560569.648722:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+49:11453:x1874392788311552:12345-192.168.201.56@tcp:101:bash.0 Request processed in 16689us (16968us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787560569.648731:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 160 00000100:00100000:3.0:1787560569.650445:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+48:2342:x1874392788311680:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 2585us (3022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560569.650461:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 67 00000100:00100000:3.0:1787560569.658317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.658500:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788311936 00000100:00100000:2.0:1787560569.658514:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788311936 00000100:00100000:2.0:1787560569.658594:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 161 00000100:00100000:2.0:1787560569.658607:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+48:11453:x1874392788311936:12345-192.168.201.56@tcp:36:bash.0 00010000:00010000:2.0:1787560569.659029:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.659052:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.659066:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560569.659408:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787560569.659439:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f63a3c5a reply state 00000000d9223e7a transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560569.659450:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560569.659614:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+51:11453:x1874392788311936:12345-192.168.201.56@tcp:36:bash.0 Request processed in 1007us (1313us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787560569.659623:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 161 00000020:00080000:2.0:1787560569.659629:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787560569.673101:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.673135:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.673144:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.673152:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560569.673158:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.673167:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.673191:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:1.0:1787560569.673195:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560569.673201:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.673207:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560569.674191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.674505:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788312064 00000100:00100000:2.0:1787560569.674521:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788312064 00000100:00100000:2.0:1787560569.674594:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 162 00000100:00100000:2.0:1787560569.674608:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+50:11453:x1874392788312064:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1787560569.674645:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560569.674672:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9254f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.674790:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.674820:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92548 expref: 51 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.674835:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.674920:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92548 expref: 51 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.674961:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92548 expref: 51 pid: 11858 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560569.674980:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815578112:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560569.675096:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38fac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560569.679457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560569.679600:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815578112:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560569.679650:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560569.679805:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788312192 00000100:00100000:3.0:1787560569.679822:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788312192 00010000:00010000:3.0:1787560569.679911:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92548 expref: 52 pid: 11858 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560569.679946:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 68 00000100:00100000:3.0:1787560569.679958:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:2343:x1874392788312192:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560569.679975:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560569.680002:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92548 expref: 52 pid: 11858 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.680015:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92548 expref: 52 pid: 11858 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.680043:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fa5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92548 expref: 52 pid: 11858 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.680075:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:3.0:1787560569.680081:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.680091:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.680099:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.680139:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560569.680213:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+51:2343:x1874392788312192:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 256us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560569.680222:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 68 00010000:00010000:2.0:1787560569.681316:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.681329:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560569.681390:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787560569.681396:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560569.681423:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.681468:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9254f expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.681490:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9254f expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.681500:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:2.0:1787560569.681503:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560569.681506:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710800, rc 0) 00000100:00100000:2.0:1787560569.681573:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+50:11453:x1874392788312064:12345-192.168.201.56@tcp:101:bash.0 Request processed in 6967us (7391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560569.681596:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 162 00000100:00100000:2.0:1787560569.684827:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560569.684938:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788312448 00000100:00100000:1.0:1787560569.684952:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788312448 00000100:00100000:1.0:1787560569.685027:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:1.0:1787560569.685057:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+50:11453:x1874392788312448:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:1.0:1787560569.685389:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+51:11453:x1874392788312448:12345-192.168.201.56@tcp:35:bash.0 Request processed in 335us (587us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787560569.685398:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:1.0:1787560569.775015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560569.775234:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788312704 00000100:00100000:0.0:1787560569.775248:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788312704 00000100:00100000:0.0:1787560569.775337:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 163 00000100:00100000:0.0:1787560569.775349:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+51:11463:x1874392788312704:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560569.775389:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560569.775418:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fa82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92556 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560569.775574:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787560569.775727:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fa82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92556 expref: 53 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560569.775746:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:0.0:1787560569.775749:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560569.775756:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fa82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92556 expref: 53 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560569.775787:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101600, rc 0) 00000100:00100000:0.0:1787560569.776486:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:11463:x1874392788312704:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1132us (1479us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787560569.776496:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 163 00000100:00100000:3.0:1787560569.783935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.786031:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788312832 00000100:00100000:2.0:1787560569.786051:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788312832 00000100:00100000:2.0:1787560569.786443:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 164 00000100:00100000:2.0:1787560569.786457:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:11463:x1874392788312832:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:2.0:1787560569.786566:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fa90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786587:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fa90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786598:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fa90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786613:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786618:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786622:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786748:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786756:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786762:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560569.786879:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786895:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fa90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786902:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fa90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786909:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fa90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786915:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560569.786920:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fa90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786927:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fa90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786942:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:2.0:1787560569.786945:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560569.786951:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fa90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786958:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fa90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786980:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786986:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.786999:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.787005:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560569.787008:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.787014:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.787022:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fffa00) 00010000:00010000:2.0:1787560569.787025:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560569.787028:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.787034:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fa97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.787050:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.787057:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.787062:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.787068:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560569.787070:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.787087:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.787095:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:2.0:1787560569.787098:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560569.789890:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.789925:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fa9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560569.790110:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:11463:x1874392788312832:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 3647us (6182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560569.790124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 164 00000100:00100000:2.0:1787560569.797318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560569.797688:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788313088 00000100:00100000:1.0:1787560569.797701:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788313088 00000100:00100000:1.0:1787560569.797789:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:1.0:1787560569.797817:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:11463:x1874392788313088:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:1.0:1787560569.798324:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+53:11463:x1874392788313088:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 519us (1021us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787560569.798333:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:1.0:1787560569.839579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.839736:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788313344 00000100:00100000:2.0:1787560569.839749:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788313344 00000100:00100000:2.0:1787560569.839960:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 165 00000100:00100000:2.0:1787560569.839970:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+53:11466:x1874392788313344:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560569.840000:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560569.840024:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673faa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9255d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840104:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673faac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840128:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673faac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840158:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673faac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840171:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840175:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840180:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840334:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673faba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840343:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673faba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840351:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673faba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560569.840362:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787560569.840498:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673faac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840506:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673faac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840514:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673faac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840521:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560569.840533:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673faac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840542:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673faac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840556:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:2.0:1787560569.840558:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560569.840563:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673faac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840568:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673faac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840581:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840584:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fab3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840588:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840592:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560569.840593:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840596:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840600:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fffa00) 00010000:00010000:2.0:1787560569.840601:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560569.840607:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fab3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840611:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840655:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673faa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9255d expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840664:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673faba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9255d expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.840670:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:2.0:1787560569.840671:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560569.840673:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710000, rc 0) 00000100:00100000:2.0:1787560569.840889:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:11466:x1874392788313344:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 880us (1284us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787560569.840898:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 165 00000100:00100000:3.0:1787560569.845048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560569.845117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.845160:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788313600 00000100:00100000:2.0:1787560569.845174:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788313600 00000100:00100000:1.0:1787560569.845366:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788313472 00000100:00100000:1.0:1787560569.845371:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788313472 00000100:00100000:1.0:1787560569.845418:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 166 00000100:00100000:1.0:1787560569.845431:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:11466:x1874392788313472:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:1.0:1787560569.845523:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.845543:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.845556:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.845586:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.845613:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fac8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.845621:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.845628:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560569.845633:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.845641:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fac8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.845656:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:1.0:1787560569.845659:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560569.845664:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fac8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560569.845670:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fac8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560569.845759:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:11466:x1874392788313472:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 330us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560569.845768:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 166 00000100:00100000:2.0:1787560569.847307:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:2.0:1787560569.847332:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:2344:x1874392788313600:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560569.847360:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560569.847385:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673faba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9255d expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.847402:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:2.0:1787560569.847407:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560569.847489:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:2344:x1874392788313600:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 167us (2371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560569.848552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.848638:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:0.0:1787560569.848660:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788313856 00000100:00100000:0.0:1787560569.848670:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788313856 00000100:00100000:0.0:1787560569.848749:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:0.0:1787560569.848761:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:11466:x1874392788313856:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560569.849082:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:11466:x1874392788313856:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 322us (533us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787560569.849090:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:0.0:1787560569.952992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.953175:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788314112 00000100:00100000:2.0:1787560569.953190:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788314112 00000100:00100000:2.0:1787560569.953313:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 167 00000100:00100000:2.0:1787560569.953328:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:11484:x1874392788314112:12345-192.168.201.56@tcp:101:cat.0 00010000:00010000:2.0:1787560569.953374:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560569.953404:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673facf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92564 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.953576:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fad6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.953593:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.953902:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560569.953918:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787560569.954167:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05673facf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92564 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.954199:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fad6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92564 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560569.954209:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:2.0:1787560569.954213:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787560569.954226:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710600, rc 0) 00000100:00100000:2.0:1787560569.954725:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11484:x1874392788314112:12345-192.168.201.56@tcp:101:cat.0 Request processed in 1397us (1744us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787560569.954734:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 167 00000100:00100000:2.0:1787560569.981444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560569.981719:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788314240 00000100:00100000:3.0:1787560569.981733:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788314240 00000100:00100000:3.0:1787560569.981819:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 168 00000100:00100000:3.0:1787560569.981833:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11485:x1874392788314240:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560569.981914:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560569.981942:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673fae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9256b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.982036:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673faeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.982053:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673faeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.982080:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673faeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560569.982171:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787560569.982175:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560569.982203:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673faeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.982236:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673fae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9256b expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.982263:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673faeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9256b expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.982273:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560569.982276:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560569.982280:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb400, rc 0) 00000100:00100000:3.0:1787560569.982358:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11485:x1874392788314240:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 527us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560569.982366:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 168 00000100:00100000:1.0:1787560569.989238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560569.989419:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788314624 00000100:00100000:2.0:1787560569.989433:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788314624 00000100:00100000:2.0:1787560569.989511:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:2.0:1787560569.989524:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11485:x1874392788314624:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:2.0:1787560569.990033:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11485:x1874392788314624:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 509us (809us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787560569.990041:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:0.0:1787560569.992329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560569.992702:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788314752 00000100:00100000:3.0:1787560569.992714:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788314752 00000100:00100000:3.0:1787560569.992795:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:3.0:1787560569.992819:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9adaad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11485:x1874392788314752:12345-192.168.201.56@tcp:103:lfs.0 00010000:00010000:3.0:1787560569.992838:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787560569.992904:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fa7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9254f expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.992937:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fad6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92564 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.992951:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673f986 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92510 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.992964:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d995c27200) 00010000:00010000:3.0:1787560569.992976:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560569.993051:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9adaad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:11485:x1874392788314752:12345-192.168.201.56@tcp:103:lfs.0 Request processed in 234us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560569.993069:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:1.0:1787560569.997936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560569.998104:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788314880 00000100:00100000:3.0:1787560569.998117:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788314880 00000100:00100000:3.0:1787560569.998192:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 169 00000100:00100000:3.0:1787560569.998206:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:11485:x1874392788314880:12345-192.168.201.56@tcp:58:lfs.0 00010000:00010000:3.0:1787560569.998402:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673faf2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.998424:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673faf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560569.998446:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673faf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560569.998706:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787560569.998826:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:11485:x1874392788314880:12345-192.168.201.56@tcp:58:lfs.0 Request processed in 621us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560569.998834:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 169 00000100:00100000:1.0:1787560570.022678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560570.022958:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788315008 00000100:00100000:2.0:1787560570.022973:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788315008 00000100:00100000:3.0:1787560570.023243:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 170 00000100:00100000:3.0:1787560570.023270:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:11487:x1874392788315008:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560570.023297:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560570.023325:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673faf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92572 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023407:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023424:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023436:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023457:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023465:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023472:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023619:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023629:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023636:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560570.023680:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787560570.023685:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560570.023709:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023722:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023731:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023738:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023744:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023750:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560570.023755:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023763:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023786:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560570.023789:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560570.023795:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023812:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023834:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023841:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023896:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023903:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560570.023907:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023913:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023922:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d9a1269200) 00010000:00010000:3.0:1787560570.023924:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560570.023927:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023934:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.023990:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673faf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92572 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.024005:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92572 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.024013:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269800) 00010000:00010000:3.0:1787560570.024015:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560570.024018:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb000, rc 0) 00000100:00100000:3.0:1787560570.024112:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11487:x1874392788315008:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 858us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560570.024121:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 170 00000040:00080000:0.0:1787560570.191185:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787560570.191270:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560570.191331:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787560570.191341:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787560570.193349:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4227800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815578240:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787560570.195314:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560570.197489:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4227800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815578240:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787560570.198789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560570.198960:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788315136 00000100:00100000:0.0:1787560570.198972:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788315136 00000100:00100000:0.0:1787560570.199039:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 171 00000100:00100000:0.0:1787560570.199051:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99012fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11498:x1874392788315136:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787560570.199358:0:11858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787560570.199653:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99012fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11498:x1874392788315136:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 601us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560570.199662:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 171 00000100:00100000:0.0:1787560570.202390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560570.205046:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788315264 00000100:00100000:1.0:1787560570.205078:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788315264 00000100:00100000:1.0:1787560570.205175:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 172 00000100:00100000:1.0:1787560570.205190:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11498:x1874392788315264:12345-192.168.201.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787560570.205298:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb15 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205319:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205334:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205511:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fb1c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205533:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fb1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205544:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fb1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205575:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205582:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205587:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560570.205628:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787560570.205631:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560570.205654:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205664:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205669:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb15 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205674:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205678:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560570.205681:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205685:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb15 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205694:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:1.0:1787560570.205696:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560570.205700:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb15 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205704:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb15 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205716:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fb1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205719:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fb1c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205723:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fb1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205731:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560570.205733:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fb1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205736:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fb1c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205742:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff93d995c27b00) 00010000:00010000:1.0:1787560570.205743:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560570.205744:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fb1c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205748:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fb1c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205759:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205762:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205765:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205769:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560570.205770:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205774:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205789:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269800) 00010000:00010000:1.0:1787560570.205791:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560570.205793:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.205809:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fb23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560570.207924:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11498:x1874392788315264:12345-192.168.201.56@tcp:34:lhsmtool_posix.0 Request processed in 2720us (5524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560570.207943:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 172 00000100:00100000:2.0:1787560570.216734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.216935:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788315520 00000100:00100000:3.0:1787560570.216951:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788315520 00000100:00100000:3.0:1787560570.217033:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 173 00000100:00100000:3.0:1787560570.217045:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11498:x1874392788315520:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560570.217084:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560570.217120:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92579 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.217618:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.217640:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.217656:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560570.217691:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787560570.217949:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.217959:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.217968:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.217976:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560570.217981:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.217991:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.218008:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269800) 00010000:00010000:3.0:1787560570.218013:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560570.218018:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.218025:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.218279:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb2a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92579 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.218293:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:3.0:1787560570.218295:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560570.218309:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92579 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.218321:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb200, rc 0) 00000100:00100000:3.0:1787560570.218414:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11498:x1874392788315520:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 1371us (1698us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787560570.218424:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 173 00000100:00100000:2.0:1787560570.223403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.223584:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788315648 00000100:00100000:3.0:1787560570.223597:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788315648 00000100:00100000:3.0:1787560570.223660:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 174 00000100:00100000:3.0:1787560570.223672:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11498:x1874392788315648:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787560570.223727:0:6706:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787560570.223929:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11498:x1874392788315648:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 258us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560570.223939:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 174 00000100:00100000:3.0:1787560570.226440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560570.226511:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788315904 00000100:00100000:0.0:1787560570.226522:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788315904 00000100:00100000:0.0:1787560570.226600:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 175 00000100:00100000:0.0:1787560570.226614:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11498:x1874392788315904:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560570.226642:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560570.226646:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787560570.226680:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb400/0xe34191b05673faeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9256b expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.226709:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560570.226716:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560570.226734:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fb3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92580 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787560570.227319:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787560570.227568:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101a00/0xe34191b05673fb46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.227584:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101a00/0xe34191b05673fb46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.227616:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101a00/0xe34191b05673fb46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.227672:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100e00/0xe34191b05673fb3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92580 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.227687:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101a00/0xe34191b05673fb46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92580 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.227693:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:0.0:1787560570.227696:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560570.227698:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101a00, rc 0) 00000100:00100000:0.0:1787560570.227770:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11498:x1874392788315904:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 1159us (1343us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787560570.227777:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 175 00000100:00100000:2.0:1787560570.230971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.231206:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788316160 00000100:00100000:3.0:1787560570.231462:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788316160 00000100:00100000:3.0:1787560570.231583:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 176 00000100:00100000:3.0:1787560570.231597:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11498:x1874392788316160:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787560570.231679:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560570.231714:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101a00/0xe34191b05673fb46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92580 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.231738:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d987fb3600) 00010000:00010000:3.0:1787560570.231751:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560570.231810:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.231828:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.231840:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.231884:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fb5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa13417ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.231892:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fb5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa13417ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.231900:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fb5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa13417ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.231996:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232005:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb54 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232012:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232020:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560570.232025:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232033:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232065:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560570.232069:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560570.232074:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232081:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fb54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232104:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fb5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa13417ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232112:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fb5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa13417ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232118:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fb5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa13417ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232123:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eac00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560570.232126:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fb5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa13417ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232132:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fb5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa13417ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232140:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa13417ff (ffff93d9a1269200) 00010000:00010000:3.0:1787560570.232142:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560570.232145:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fb5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa13417ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.232151:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fb5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa13417ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560570.232288:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11498:x1874392788316160:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 693us (1330us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560570.232297:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 176 00000100:00100000:2.0:1787560570.235605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.235694:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788316288 00000100:00100000:3.0:1787560570.235706:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788316288 00000100:00100000:3.0:1787560570.235787:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 177 00000100:00100000:3.0:1787560570.235809:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11498:x1874392788316288:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560570.235836:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560570.235881:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92587 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.235924:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.235939:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.235952:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.236084:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92587 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.236109:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92587 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.236119:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269c00) 00010000:00010000:3.0:1787560570.236128:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787560570.236132:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eba00, rc 0) 00000100:00100000:3.0:1787560570.236197:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11498:x1874392788316288:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 400us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560570.236205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 177 00000100:00100000:0.0:1787560570.248916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560570.249029:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788316544 00000100:00100000:1.0:1787560570.249043:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788316544 00000100:00100000:1.0:1787560570.249136:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 178 00000100:00100000:1.0:1787560570.249149:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11498:x1874392788316544:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787560570.249261:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.249283:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.249304:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560570.249751:0:11858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787560570.249765:0:11858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399002916625ns, next at 400002913878ns, rc = 0 00000004:00010000:1.0:1787560570.249919:0:11858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000210aa8be reply state 0000000054b4d850 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560570.249931:0:11858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560570.250054:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11498:x1874392788316544:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 905us (1152us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787560570.250073:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 178 00010000:00010000:0.0:1787560570.253709:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.253728:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.253737:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.253744:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560570.253749:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.253768:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.253791:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269c00) 00010000:00010000:0.0:1787560570.253805:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787560570.253812:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.253819:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fb70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560570.255900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.255987:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788316672 00000100:00100000:3.0:1787560570.256000:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788316672 00000100:00100000:3.0:1787560570.256078:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 179 00000100:00100000:3.0:1787560570.256090:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:11498:x1874392788316672:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560570.256130:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560570.256159:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9258e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.256241:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9258e expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.256258:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9258e expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.256284:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269c00) 00010000:00010000:3.0:1787560570.256288:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560570.256292:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb200, rc 0) 00000100:00100000:3.0:1787560570.256372:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11498:x1874392788316672:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 284us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560570.256380:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 179 00000100:00100000:3.0:1787560570.258966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560570.259091:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788316800 00000100:00100000:0.0:1787560570.259112:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788316800 00000100:00100000:0.0:1787560570.259209:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:0.0:1787560570.259223:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788316800:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787560570.259301:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560570.259694:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2343:x1874392788316800:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 Request processed in 472us (741us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787560570.259704:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:1.0:1787560570.264006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.264115:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788317056 00000100:00100000:3.0:1787560570.264136:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788317056 00000100:00100000:3.0:1787560570.264217:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:3.0:1787560570.264235:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11498:x1874392788317056:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787560570.264553:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+62:11498:x1874392788317056:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 321us (561us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787560570.264563:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:1.0:1787560570.269138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560570.274490:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788317312 00000100:00100000:2.0:1787560570.274522:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788317312 00000100:00100000:2.0:1787560570.274670:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 180 00000100:00100000:2.0:1787560570.274685:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+62:11498:x1874392788317312:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787560570.274902:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+62:11498:x1874392788317312:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 220us (5778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560570.274933:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 180 00000100:00100000:3.0:1787560570.278820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560570.279224:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788317440 00000100:00100000:1.0:1787560570.279238:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788317440 00000100:00100000:1.0:1787560570.279318:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 181 00000100:00100000:1.0:1787560570.279330:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+62:11498:x1874392788317440:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560570.279360:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560570.279386:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673fb7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92595 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.279568:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fb85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.279586:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fb85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.279599:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fb85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560570.279643:0:11858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560570.279663:0:11858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fb85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.279693:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260800/0xe34191b05673fb7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92595 expref: 64 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.279711:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fb85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92595 expref: 63 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.279727:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269c00) 00010000:00010000:1.0:1787560570.279730:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787560570.279734:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261600, rc 0) 00000100:00100000:1.0:1787560570.280127:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+63:11498:x1874392788317440:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 797us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560570.280136:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 181 00000100:00100000:3.0:1787560570.282876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560570.284023:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788317568 00000100:00100000:1.0:1787560570.284051:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788317568 00000100:00100000:1.0:1787560570.284149:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:1.0:1787560570.284380:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2344:x1874392788317568:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560570.284405:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560570.284434:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000aa58840/0xe34191b05673fb8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9259c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560570.284482:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c027a, blocks: 0x1 00010000:00010000:1.0:1787560570.284511:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1787560570.284517:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560570.284530:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000aa58840/0xe34191b05673fb8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9259c expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.284555:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000aa58840/0xe34191b05673fb8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9259c expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.284574:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261000, rc 0) 00000100:00100000:1.0:1787560570.284680:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2344:x1874392788317568:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 520us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560570.284687:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:2.0:1787560570.287780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560570.287998:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788317824 00000100:00100000:0.0:1787560570.288012:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788317824 00000100:00100000:0.0:1787560570.288091:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 182 00000100:00100000:0.0:1787560570.288103:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+63:11498:x1874392788317824:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787560570.288586:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+63:11498:x1874392788317824:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 482us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560570.288595:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 182 00000100:00100000:3.0:1787560570.294360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560570.295429:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788317952 00000100:00100000:0.0:1787560570.295468:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788317952 00000100:00100000:0.0:1787560570.295540:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:0.0:1787560570.295553:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:11498:x1874392788317952:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560570.295577:0:8101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560570.295600:0:8101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925a3 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.295641:0:8101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000aa58840/0xe34191b05673fb8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9259c expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.295651:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560570.295657:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560570.295663:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 9 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.295705:0:8101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000aa58840/0xe34191b05673fb8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9259c expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.295720:0:8101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000aa58840/0xe34191b05673fb8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9259c expref: 9 pid: 6683 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560570.295736:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8101:1874392815578368:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560570.295877:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560570.299417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.299537:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8101:1874392815578368:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560570.299585:0:8101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 9 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.299612:0:8101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100200, rc 0) 00000100:00100000:3.0:1787560570.299692:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:11498:x1874392788317952:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 4141us (5346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560570.299703:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:2.0:1787560570.300052:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788318080 00000100:00100000:2.0:1787560570.300063:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788318080 00010000:00010000:2.0:1787560570.300113:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000aa58840/0xe34191b05673fb8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9259c expref: 9 pid: 6683 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560570.300308:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:0.0:1787560570.300323:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2343:x1874392788318080:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560570.300341:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560570.300389:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000aa58840/0xe34191b05673fb8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9259c expref: 9 pid: 6683 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.300404:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000aa58840/0xe34191b05673fb8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9259c expref: 9 pid: 6683 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.300432:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000aa58840/0xe34191b05673fb8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9259c expref: 9 pid: 6683 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.300450:0:7630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560570.300455:0:7630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560570.300466:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 8 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.300477:0:7630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 8 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.300517:0:7630:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 8 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560570.300533:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7630:1874392815578496:192.168.201.56@tcp:105: 00000100:00100000:0.0:1787560570.300621:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503900 going to sleep for 11 seconds 00000100:00100000:1.0:1787560570.309439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560570.310246:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788318208 00000100:00100000:2.0:1787560570.310261:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788318208 00002000:00100000:2.0:1787560570.310365:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93d998b70700 x1874392788318208/t0(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:686/0 lens 504/0 e 0 to 0 dl 1787560581 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560570.310375:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d998b70700 with x1874392788318208 ext(0->8) 00002000:00010000:2.0:1787560570.310381:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d998b70700 00000100:00100000:2.0:1787560570.310418:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:2.0:1787560570.310427:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2343:x1874392788318208:12345-192.168.201.56@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787560570.311204:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:2343:x1874392788318208:12345-192.168.201.56@tcp:4:lhsmtool_posix.0 Request processed in 772us (1775us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787560570.311222:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00002000:00100000:3.0:1787560570.311233:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff93d998b70700 x1874392788318208/t4294967314(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:686/0 lens 504/448 e 0 to 0 dl 1787560581 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787560570.311243:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d998b70700 with x1874392788318208 ext(0->8) 00002000:00010000:3.0:1787560570.311247:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d998b70700 00000100:00100000:2.0:1787560570.313764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.313882:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788318336 00000100:00100000:3.0:1787560570.313915:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788318336 00000100:00100000:3.0:1787560570.313995:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 183 00000100:00100000:3.0:1787560570.314008:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+63:11498:x1874392788318336:12345-192.168.201.56@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787560570.315724:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7630:1874392815578496:192.168.201.56@tcp:105: 00010000:00010000:0.0:1787560570.315762:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560570.316022:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:2343:x1874392788318080:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 15701us (16616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560570.316049:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:2.0:1787560570.387647:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+63:11498:x1874392788318336:12345-192.168.201.56@tcp:44:lhsmtool_posix.0 Request processed in 73623us (73882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560570.387665:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 183 00000001:00080000:2.0:1787560570.387715:0:12266:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:2.0:1787560570.387749:0:12266:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1787560570.387754:0:12266:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1787560570.387804:0:12266:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787560570.387823:0:12266:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d882e90c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787560570.387828:0:12266:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d9bf946200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d882e90600 00000020:00080000:2.0:1787560570.387878:0:12266:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d9bf946a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d986a06400 00000001:00080000:2.0:1787560570.387929:0:12266:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1787560570.388028:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1787560570.388373:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815578624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787560570.388454:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560570.388522:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560570.388529:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815578752:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787560570.388553:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560570.388595:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815578624 00000100:00100000:0.0:1787560570.388605:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815578624 00000100:00100000:0.0:1787560570.388664:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815578752 00000100:00100000:0.0:1787560570.388668:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815578752 00000100:00100000:0.0:1787560570.388694:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787560570.388704:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815578624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787560570.388940:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787560570.388944:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787560570 00002000:00010000:0.0:1787560570.388947:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787560570.388949:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787560570 -> 1787560570 00002000:00010000:0.0:1787560570.388952:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787560570.388993:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874392815578624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 290us (539us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787560570.389001:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787560570.389023:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787560570.389030:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874392815578752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787560570.389047:0:6685:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1787560570.390200:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c0278, atime: 0x6a8c0278, ctime: 0x6a8c0278, blocks: 0x1 00010000:00010000:0.0:1787560570.390217:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673fb9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.390256:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1787560570.390262:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560570.390270:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673fb9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.390291:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673fb9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.390302:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673fb9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.390310:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673fb9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.390327:0:6685:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787560570.391020:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1874392815578752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1985us (2460us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787560570.391032:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787560570.391214:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560570.391222:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787560570.391316:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d9bab95880/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787560570.391326:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815578752:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1787560570.391343:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d98735ca80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787560570.391348:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815578624:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787560570.391438:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560570.391449:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673fb9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.391462:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101c00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560570.391467:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673fb9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.391479:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673fb9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.391505:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673fb9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.391513:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b05673fb9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.391540:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560570.391542:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560570.391544:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787560570.391777:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787560570.395247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.395359:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788318464 00000100:00100000:3.0:1787560570.395373:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788318464 00000100:00100000:3.0:1787560570.395448:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:3.0:1787560570.395461:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:2345:x1874392788318464:12345-192.168.201.56@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787560570.496212:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:2345:x1874392788318464:12345-192.168.201.56@tcp:16:lhsmtool_posix.0 Request processed in 100738us (100964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560570.496246:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 55 00000001:00080000:0.0:1787560570.496290:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1787560570.496298:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1787560570.496304:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1787560570.500667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560570.500915:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788318720 00000100:00100000:1.0:1787560570.500937:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788318720 00000100:00100000:1.0:1787560570.501027:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 184 00000100:00100000:1.0:1787560570.501042:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+18:11498:x1874392788318720:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787560570.501131:0:11858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560570.501166:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fb85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92595 expref: 18 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.501186:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269c00) 00010000:00010000:1.0:1787560570.501191:0:11858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560570.501225:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.501237:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.501244:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560570.501564:0:11858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005482ce0 reply state 000000002df60b23 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560570.501574:0:11858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560570.501800:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:11498:x1874392788318720:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 751us (1135us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787560570.501809:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 184 00010000:00010000:2.0:1787560570.504936:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560570.504960:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560570.504968:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560570.504975:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560570.504981:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560570.504989:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560570.505014:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269c00) 00010000:00010000:2.0:1787560570.505017:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560570.505023:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560570.505030:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fba1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560570.505283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.505759:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788318848 00000100:00100000:3.0:1787560570.505773:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788318848 00000100:00100000:3.0:1787560570.505883:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:3.0:1787560570.505896:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2343:x1874392788318848:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787560570.506258:0:8101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787560570.506262:0:8101:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787560570 -> 1787560569 00002000:00010000:3.0:1787560570.506265:0:8101:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787560568 00002000:00010000:3.0:1787560570.506267:0:8101:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787560570 -> 1787560569 00002000:00010000:3.0:1787560570.506270:0:8101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787560570.506356:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788318848:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 Request processed in 461us (1079us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787560570.506365:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:3.0:1787560570.508592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560570.508689:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788319104 00000100:00100000:1.0:1787560570.508700:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788319104 00000100:00100000:1.0:1787560570.508772:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 185 00000100:00100000:1.0:1787560570.508784:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+18:11498:x1874392788319104:12345-192.168.201.56@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787560570.508931:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.508951:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92587 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.508960:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.509002:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92587 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.509019:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92587 expref: 18 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560570.509037:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815578880:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560570.509174:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9baace240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560570.511975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560570.512033:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788319232 00000100:00100000:1.0:1787560570.512055:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788319232 00010000:00010000:1.0:1787560570.512605:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92587 expref: 19 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560570.512656:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:1.0:1787560570.512670:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:2343:x1874392788319232:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560570.512691:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560570.512699:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92587 expref: 19 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.512735:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92587 expref: 19 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.512766:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269c00) 00010000:00010000:1.0:1787560570.512773:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.512784:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.512801:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.512829:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560570.512921:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:2343:x1874392788319232:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 256us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560570.512929:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 70 00010000:00010000:3.0:1787560570.513202:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fb69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92587 expref: 18 pid: 5837 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560570.513229:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815578880:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560570.513394:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.513415:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.513422:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.513460:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.513466:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.513474:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.513480:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560570.513485:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.513493:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.513503:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269c00) 00010000:00010000:3.0:1787560570.513506:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787560570.513510:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.513516:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fba8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560570.513578:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:11498:x1874392788319104:12345-192.168.201.56@tcp:55:lhsmtool_posix.0 Request processed in 4797us (4996us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787560570.513592:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 185 00000100:00100000:1.0:1787560570.537043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560570.538233:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788319360 00000100:00100000:0.0:1787560570.538251:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788319360 00000100:00100000:0.0:1787560570.538336:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:0.0:1787560570.538349:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2342:x1874392788319360:12345-192.168.201.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787560570.538410:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.538437:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 8 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.538448:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560570.538453:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560570.538458:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.538506:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 8 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560570.538524:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 8 pid: 8101 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560570.538542:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815579008:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560570.538810:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998503a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560570.543504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560570.543642:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a00380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815579008:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560570.543676:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560570.543879:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788319488 00000100:00100000:3.0:1787560570.543889:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788319488 00010000:00010000:3.0:1787560570.543935:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 9 pid: 8101 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560570.543978:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 71 00000100:00100000:3.0:1787560570.543990:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2342:x1874392788319488:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560570.544010:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560570.544040:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 9 pid: 8101 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.544054:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 9 pid: 8101 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.544082:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf253887/0xe34191b05673fb93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925a3 expref: 9 pid: 8101 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.544226:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560570.544233:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560570.544240:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.544362:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560570.544490:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560570.544563:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2342:x1874392788319488:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 572us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560570.544571:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 71 00010000:00010000:3.0:1787560570.545863:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.545881:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.545923:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.545933:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.545942:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.545950:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101200 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560570.545955:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.545965:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.545986:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.546016:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053fbfeb4/0xe34191b05673fbaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560570.549259:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788319360:12345-192.168.201.56@tcp:1:lhsmtool_posix.0 Request processed in 10895us (12215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560570.549280:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:1.0:1787560570.565453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.576150:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788319744 00000100:00100000:3.0:1787560570.576175:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788319744 00000100:00100000:3.0:1787560570.579399:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 186 00000100:00100000:3.0:1787560570.579429:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+17:11498:x1874392788319744:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787560570.579544:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fbb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.579567:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fbb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.579581:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fbb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.579884:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.579898:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9258e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.579908:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.579953:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9258e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.579986:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9258e expref: 18 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560570.580007:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883425180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815579136:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560570.580289:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998480540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560570.587513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560570.587556:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788319872 00000100:00100000:1.0:1787560570.587568:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788319872 00010000:00010000:1.0:1787560570.587627:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb77 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9258e expref: 19 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560570.587668:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00100000:1.0:1787560570.587680:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:2343:x1874392788319872:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560570.587709:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560570.587717:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb77 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9258e expref: 19 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.587734:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9258e expref: 19 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.587763:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269c00) 00010000:00010000:1.0:1787560570.587769:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.587780:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.587788:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.587823:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560570.587909:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:2343:x1874392788319872:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 230us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560570.587917:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 72 00010000:00010000:1.0:1787560570.588048:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673fb77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9258e expref: 18 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560570.588072:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883425180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815579136:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560570.588226:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.588239:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.588999:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560570.589660:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787560570.589884:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787560570.589943:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787560570.590059:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6706:1874392815579264:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787560570.590905:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560570.591407:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787560570.594734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815579264 00000100:00100000:3.0:1787560570.594752:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815579264 00000100:00100000:2.0:1787560570.600009:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560570.600026:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6706:x1874392815579264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787560570.600318:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6706:x1874392815579264:12345-0@lo:1000:mdt00_003.0 Request processed in 295us (9469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560570.600328:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560570.600506:0:6706:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787560570.600513:0:6706:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d98735ca80, transno 4294967315 00000100:00100000:1.0:1787560570.600533:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6706:1874392815579264:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787560570.604744:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787560570.604925:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987359180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6706:1874392815579392:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787560570.605025:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560570.605070:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560570.605952:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815579392 00000100:00100000:0.0:1787560570.605967:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815579392 00000100:00100000:0.0:1787560570.606032:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560570.606044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6706:x1874392815579392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787560570.606387:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6706:x1874392815579392:12345-0@lo:1000:mdt00_003.0 Request processed in 344us (1361us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787560570.606396:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560570.611640:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987359180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6706:1874392815579392:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787560570.611710:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611724:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611733:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611740:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eac00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560570.611747:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611769:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611799:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269c00) 00010000:00010000:1.0:1787560570.611802:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560570.611809:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611816:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673fbbd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611876:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673faf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611883:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673faf2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611890:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673faf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611895:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebc00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560570.611898:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673faf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611904:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673faf2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611913:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269800) 00010000:00010000:1.0:1787560570.611915:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560570.611918:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673faf2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611933:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673faf2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611962:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611980:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92572 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.611989:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.612037:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92572 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.612069:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92572 expref: 21 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560570.612160:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987358380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815579520:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560570.612435:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560570.629989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.630035:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788320000 00000100:00100000:3.0:1787560570.630057:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788320000 00010000:00010000:3.0:1787560570.630118:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92572 expref: 22 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560570.630170:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 73 00000100:00100000:3.0:1787560570.630182:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:2343:x1874392788320000:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560570.630203:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560570.630212:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92572 expref: 22 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.630230:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92572 expref: 22 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.630261:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269800) 00010000:00010000:3.0:1787560570.630267:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.630304:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.630314:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.630339:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560570.630406:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:2343:x1874392788320000:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 225us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560570.630415:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 73 00010000:00010000:1.0:1787560570.631416:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fb0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92572 expref: 21 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560570.631445:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987358380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815579520:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560570.631477:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631488:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631504:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631519:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631526:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631533:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631539:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560570.631545:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631553:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631569:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269800) 00010000:00010000:1.0:1787560570.631572:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560570.631576:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631582:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fbc4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631593:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fbb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631600:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fbb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631612:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fbb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631617:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560570.631619:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fbb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631625:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fbb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631633:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269800) 00010000:00010000:1.0:1787560570.631635:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787560570.631637:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fbb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.631643:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fbb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560570.632075:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560570.632080:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560570.634954:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787560570.634977:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787560570.636442:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:11498:x1874392788319744:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 57011us (70989us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787560570.636460:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 186 00000020:00080000:1.0:1787560570.636468:0:6706:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00010000:00010000:3.0:1787560570.645111:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560570.645208:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560570.645241:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788320256 00000100:00100000:3.0:1787560570.645255:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788320256 00000100:00100000:3.0:1787560570.645322:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:3.0:1787560570.645333:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae744850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:11498:x1874392788320256:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787560570.646207:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787560570.646330:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787560570.646383:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.646402:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.646414:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.646423:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.646442:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.646448:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560570.646472:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787560570.646597:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae744850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:11498:x1874392788320256:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 1261us (1392us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787560570.646608:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 50 00000020:00080000:3.0:1787560570.646615:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787560570.647259:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560570.647268:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.647286:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea200 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560570.647291:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.647300:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.647317:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff93d9a1269b00) 00010000:00010000:1.0:1787560570.647320:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787560570.647326:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.647332:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fbcb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560570.647349:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560570.647351:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560570.647352:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787560570.665424:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1787560570.665443:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1787560570.804624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560570.804711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560570.804747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560570.804797:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788320640 00000100:00100000:2.0:1787560570.804809:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788320640 00000100:00100000:2.0:1787560570.804922:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 156 00000100:00100000:2.0:1787560570.804934:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788320640:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560570.805034:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2342:x1874392788320640:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560570.809186:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788320384 00000100:00100000:0.0:1787560570.809204:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788320384 00000100:00100000:0.0:1787560570.809283:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 296 00000100:00100000:0.0:1787560570.809295:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788320384:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560570.809390:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2342:x1874392788320384:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 97us (4677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560570.809398:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 296 00000100:00080000:0.0:1787560570.809446:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560570.809804:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 156 00000100:00100000:3.0:1787560570.811718:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788320512 00000100:00100000:3.0:1787560570.811735:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788320512 00000100:00100000:3.0:1787560570.811952:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 91 00000100:00100000:3.0:1787560570.811965:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788320512:12345-192.168.201.56@tcp:400:kworker.0 00000100:00080000:0.0:1787560570.812296:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560570.812442:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788320512:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 124us (7479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560570.812452:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 91 00000040:00080000:1.0:1787560570.897455:0:12457:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560570.897469:0:12457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560570.897527:0:12457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787560570.897534:0:12457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787560571.062969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.064517:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788320896 00000100:00100000:3.0:1787560571.064535:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788320896 00000100:00100000:3.0:1787560571.064681:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 187 00000100:00100000:3.0:1787560571.064695:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:11508:x1874392788320896:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560571.064727:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560571.064756:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fbd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925aa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787560571.066228:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787560571.066991:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673fbd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.067026:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673fbd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.067041:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673fbd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560571.067058:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787560571.068678:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fbd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925aa expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.068710:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673fbd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925aa expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.068720:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560571.068724:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787560571.068728:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eae00, rc 0) 00000100:00100000:3.0:1787560571.068838:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:11508:x1874392788320896:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 4145us (5886us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787560571.068872:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 187 00000100:00100000:1.0:1787560571.074477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.074839:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788321024 00000100:00100000:3.0:1787560571.074938:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788321024 00000100:00100000:0.0:1787560571.075419:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 188 00000100:00100000:0.0:1787560571.075431:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:11508:x1874392788321024:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:0.0:1787560571.075533:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673fbe7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.075556:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673fbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.075587:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673fbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.075619:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fbee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.075626:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fbee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.075632:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fbee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076271:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076281:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076289:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560571.076338:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076353:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673fbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076360:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673fbe7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076367:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673fbe7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076373:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560571.076378:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673fbe7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076392:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673fbe7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076406:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560571.076409:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560571.076414:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673fbe7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076421:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101800/0xe34191b05673fbe7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076432:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fbee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076438:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fbee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076444:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fbee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076449:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560571.076451:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fbee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076457:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fbee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076463:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fb3900) 00010000:00010000:0.0:1787560571.076465:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560571.076467:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fbee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076480:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fbee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076495:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076501:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076505:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076509:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560571.076512:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076518:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076525:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d987fb3a00) 00010000:00010000:0.0:1787560571.076527:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560571.076530:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.076536:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100000/0xe34191b05673fbf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560571.076700:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:11508:x1874392788321024:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 1267us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560571.076710:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 188 00000100:00100000:2.0:1787560571.088197:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560571.088243:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815579648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560571.088348:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560571.088678:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815579648 00000100:00100000:1.0:1787560571.088689:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815579648 00000100:00100000:1.0:1787560571.088765:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787560571.088778:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815579648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560571.088829:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1787560571.088922:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815579648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560571.088929:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787560571.089030:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815579648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560571.142099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.142328:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788321280 00000100:00100000:3.0:1787560571.142343:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788321280 00000100:00100000:3.0:1787560571.142451:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 189 00000100:00100000:3.0:1787560571.142464:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:11511:x1874392788321280:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560571.142493:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560571.142520:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fbfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925b1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.142643:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.142662:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.142676:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.142691:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.142696:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.142701:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144352:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144368:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144378:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560571.144389:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787560571.144489:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144497:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144514:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144520:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560571.144526:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144535:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144549:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560571.144552:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560571.144556:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144561:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144575:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144581:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144587:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144592:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560571.144595:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144611:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144620:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d9a1269200) 00010000:00010000:3.0:1787560571.144622:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560571.144625:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144631:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144693:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fbfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b1 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144710:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b1 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.144718:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:3.0:1787560571.144721:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560571.144723:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea600, rc 0) 00000100:00100000:3.0:1787560571.144832:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:11511:x1874392788321280:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 2370us (2753us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787560571.144842:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 189 00000100:00100000:3.0:1787560571.148819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560571.148973:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788321408 00000100:00100000:1.0:1787560571.148985:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788321408 00000100:00100000:1.0:1787560571.149065:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 190 00000100:00100000:1.0:1787560571.149077:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:11511:x1874392788321408:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:1.0:1787560571.149294:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.149314:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.149327:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.149359:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.149366:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.149374:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.149380:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560571.149385:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.149414:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.149428:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:1.0:1787560571.149431:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560571.149435:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.149442:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560571.149531:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:11511:x1874392788321408:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 457us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560571.149540:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 190 00000100:00100000:1.0:1787560571.159216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560571.159256:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788321664 00000100:00100000:1.0:1787560571.159269:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788321664 00000100:00100000:1.0:1787560571.159334:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:1.0:1787560571.159344:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:11511:x1874392788321664:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:1.0:1787560571.159618:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:11511:x1874392788321664:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 274us (415us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787560571.159625:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:2.0:1787560571.191422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560571.195966:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788321920 00000100:00100000:1.0:1787560571.195987:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788321920 00000100:00100000:1.0:1787560571.196908:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 191 00000100:00100000:1.0:1787560571.196925:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:11046:x1874392788321920:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:1.0:1787560571.196960:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560571.196997:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925b8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.197149:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.197167:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b1 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.197179:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.197228:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b1 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.197245:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b1 expref: 28 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560571.197275:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874392815579776:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560571.197402:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560571.204215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560571.204283:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98735ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1874392815579776:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560571.204331:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560571.204369:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788322048 00000100:00100000:1.0:1787560571.204377:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788322048 00010000:00010000:1.0:1787560571.204423:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b1 expref: 29 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560571.204487:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:1.0:1787560571.204499:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:2342:x1874392788322048:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560571.204519:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560571.204527:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b1 expref: 29 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.204541:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b1 expref: 29 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.204571:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fc11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b1 expref: 29 pid: 5838 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.204594:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:1.0:1787560571.204600:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.204612:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.204620:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.204647:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560571.204712:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+28:2342:x1874392788322048:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 215us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560571.204721:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 74 00010000:00010000:1.0:1787560571.204753:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.204768:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560571.204803:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787560571.205020:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fc26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b8 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.205039:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b8 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.205047:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:1.0:1787560571.205050:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560571.205053:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261400, rc 0) 00000100:00100000:1.0:1787560571.205081:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+28:11046:x1874392788321920:12345-192.168.201.56@tcp:101:bash.0 Request processed in 8164us (13675us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787560571.205088:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 191 00000100:00100000:3.0:1787560571.215518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.215562:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788322304 00000100:00100000:3.0:1787560571.215575:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788322304 00000100:00100000:3.0:1787560571.215648:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 192 00000100:00100000:3.0:1787560571.215674:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b451ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+28:11046:x1874392788322304:12345-192.168.201.56@tcp:36:bash.0 00010000:00010000:3.0:1787560571.216073:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.216095:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.216109:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560571.216170:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787560571.216198:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000011f5114 reply state 00000000aada0886 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560571.216208:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787560571.219536:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787560571.219792:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b451ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:11046:x1874392788322304:12345-192.168.201.56@tcp:36:bash.0 Request processed in 4103us (4270us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787560571.219805:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 192 00000020:00080000:3.0:1787560571.219813:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787560571.223745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:1.0:1787560571.225957:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.225977:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.225985:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.225991:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebe00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560571.225997:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.226021:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.226053:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:1.0:1787560571.226057:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560571.226061:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.226068:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fc3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560571.226537:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788322432 00000100:00100000:2.0:1787560571.226551:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788322432 00000100:00100000:2.0:1787560571.226699:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 193 00000100:00100000:2.0:1787560571.226712:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+31:11046:x1874392788322432:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1787560571.226744:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560571.226764:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673fc42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925bf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.226864:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673fc42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925bf expref: 32 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.226880:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673fc42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925bf expref: 32 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.226904:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:2.0:1787560571.226907:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560571.226911:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711600, rc 0) 00000100:00100000:2.0:1787560571.226991:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:11046:x1874392788322432:12345-192.168.201.56@tcp:101:bash.0 Request processed in 282us (3260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560571.226996:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 193 00000100:00100000:1.0:1787560571.230225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560571.230838:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788322560 00000100:00100000:0.0:1787560571.230888:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788322560 00000100:00100000:0.0:1787560571.230966:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:0.0:1787560571.230978:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:11046:x1874392788322560:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560571.231004:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560571.231029:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9571766/0xe34191b05673fc49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925c6 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560571.231065:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c0279, atime: 0x6a8c0278, ctime: 0x6a8c0279, blocks: 0xb 00010000:00010000:0.0:1787560571.231094:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1787560571.231100:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560571.231111:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9571766/0xe34191b05673fc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925c6 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.231128:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9571766/0xe34191b05673fc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925c6 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.231145:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100c00, rc 0) 00000100:00100000:0.0:1787560571.231224:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:11046:x1874392788322560:12345-192.168.201.56@tcp:101:bash.0 Request processed in 248us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560571.231233:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:3.0:1787560571.234027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560571.234152:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788322688 00000100:00100000:1.0:1787560571.234166:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788322688 00002000:00010000:1.0:1787560571.234227:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787560571.234232:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9b4518700 with x1874392788322688 ext(0->18446744073709551615) 00002000:00010000:1.0:1787560571.234247:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d9b4518700. 00000100:00100000:1.0:1787560571.234290:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:1.0:1787560571.234303:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788322688:12345-192.168.201.56@tcp:10:bash.0 00002000:00010000:1.0:1787560571.234677:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787560571.234681:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787560569 -> 1787560571 00002000:00010000:1.0:1787560571.234684:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787560568 -> 1787560568 00002000:00010000:1.0:1787560571.234685:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787560569 -> 1787560571 00002000:00010000:1.0:1787560571.234688:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787560571.234772:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2343:x1874392788322688:12345-192.168.201.56@tcp:10:bash.0 Request processed in 471us (757us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787560571.234790:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00002000:00010000:1.0:1787560571.234812:0:6689:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787560571.234815:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9b4518700 with x1874392788322688 ext(0->18446744073709551615) 00002000:00010000:1.0:1787560571.234820:0:6689:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d9b4518700. 00000100:00100000:1.0:1787560571.295663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560571.296388:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788322816 00000100:00100000:2.0:1787560571.296401:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788322816 00000100:00100000:2.0:1787560571.296470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 194 00000100:00100000:2.0:1787560571.296492:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:11525:x1874392788322816:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:2.0:1787560571.296613:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fc50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.296635:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fc50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.296649:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fc50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.296664:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fc57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.296669:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fc57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.296673:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fc57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297525:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297536:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297543:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560571.297674:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297696:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fc50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297703:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fc50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297710:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fc50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297716:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560571.297721:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fc50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297729:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fc50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297743:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560571.297746:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560571.297752:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fc50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297757:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711000/0xe34191b05673fc50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297770:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fc57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297776:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fc57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297979:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fc57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297990:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560571.297993:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fc57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.297999:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fc57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.298008:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fff600) 00010000:00010000:3.0:1787560571.298011:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560571.298013:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fc57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.298019:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b05673fc57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.298042:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.298048:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.298053:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.298058:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560571.298061:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.298068:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.298149:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:3.0:1787560571.298152:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560571.298155:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.298161:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560571.298321:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:11525:x1874392788322816:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 1829us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560571.298333:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 194 00000100:00100000:3.0:1787560571.350649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560571.350772:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788323072 00000100:00100000:0.0:1787560571.350822:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788323072 00000100:00100000:0.0:1787560571.350942:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 195 00000100:00100000:0.0:1787560571.350956:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:11528:x1874392788323072:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560571.351013:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560571.351044:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673fc65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925cd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351322:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673fc6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351338:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673fc6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351349:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673fc6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351361:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fc73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351366:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fc73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351370:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fc73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351722:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fc7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351729:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fc7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351734:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fc7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560571.351743:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787560571.351926:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673fc6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351934:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673fc6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351941:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673fc6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351947:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560571.351951:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673fc6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351970:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673fc6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351984:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560571.351987:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560571.351992:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673fc6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.351997:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673fc6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.352011:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fc73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.352018:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fc73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.352024:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fc73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.352028:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560571.352038:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fc73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.352045:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fc73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.352053:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fb3c00) 00010000:00010000:0.0:1787560571.352056:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560571.352059:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fc73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.352064:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fc73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.352387:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101200/0xe34191b05673fc65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925cd expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.352405:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fc7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925cd expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.352413:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:0.0:1787560571.352415:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787560571.352418:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101400, rc 0) 00000100:00100000:0.0:1787560571.352548:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:11528:x1874392788323072:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1595us (1913us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787560571.352555:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 195 00000100:00100000:0.0:1787560571.362067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560571.362403:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788323200 00000100:00100000:2.0:1787560571.362416:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788323200 00000100:00100000:2.0:1787560571.362483:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 196 00000100:00100000:2.0:1787560571.362495:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:11528:x1874392788323200:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:2.0:1787560571.362584:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.362601:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b8 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.362608:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.362664:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b8 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.362676:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b8 expref: 34 pid: 5839 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560571.362690:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815579904:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560571.362810:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9a59c1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560571.371007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.371283:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788323456 00000100:00100000:3.0:1787560571.371296:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788323456 00000100:00100000:3.0:1787560571.371371:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:3.0:1787560571.371384:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+35:5584:x1874392788323456:12345-192.168.201.56@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787560571.371838:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+36:5584:x1874392788323456:12345-192.168.201.56@tcp:35:ldlm_bl.0 Request processed in 454us (845us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787560571.371880:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:0.0:1787560571.375094:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf9c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815579904:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560571.375141:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560571.386266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.386360:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788323584 00000100:00100000:3.0:1787560571.386373:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788323584 00010000:00010000:3.0:1787560571.386431:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b8 expref: 36 pid: 5839 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560571.386480:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:3.0:1787560571.386493:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9adaaf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+36:2343:x1874392788323584:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560571.386534:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560571.386544:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b8 expref: 36 pid: 5839 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.386562:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b8 expref: 36 pid: 5839 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.386602:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673fc2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925b8 expref: 36 pid: 5839 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.386624:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:3.0:1787560571.386630:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.386641:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.386649:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.386686:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560571.386764:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9adaaf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+35:2343:x1874392788323584:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 273us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560571.386772:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 75 00010000:00010000:0.0:1787560571.387306:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.387317:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.387356:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.387363:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.387370:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.387376:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560571.387381:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.387389:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.387401:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:0.0:1787560571.387404:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560571.387409:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.387415:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b05673fc88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560571.387482:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:11528:x1874392788323200:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 24986us (25429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560571.387502:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 196 00000100:00100000:0.0:1787560571.389989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.390231:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788323840 00000100:00100000:3.0:1787560571.390244:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788323840 00000100:00100000:3.0:1787560571.390303:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:3.0:1787560571.390315:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+34:11528:x1874392788323840:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:3.0:1787560571.390679:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+35:11528:x1874392788323840:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 363us (700us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787560571.390687:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:2.0:1787560571.519837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.519962:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788324096 00000100:00100000:3.0:1787560571.519976:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788324096 00000100:00100000:3.0:1787560571.520146:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 197 00000100:00100000:3.0:1787560571.520157:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+35:11539:x1874392788324096:12345-192.168.201.56@tcp:101:cat.0 00010000:00010000:3.0:1787560571.520187:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560571.520212:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925d4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520295:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520309:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520319:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520331:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520336:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520340:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520721:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520740:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520748:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560571.520760:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787560571.520944:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520953:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520960:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520967:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560571.520973:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520982:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.520995:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560571.520997:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560571.521002:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.521007:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fc96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.521029:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.522378:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.522386:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.522392:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560571.522397:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.522404:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.522419:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d9a1269200) 00010000:00010000:3.0:1787560571.522423:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560571.522427:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.522434:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fc9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.522521:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fc8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925d4 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.522543:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925d4 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.522551:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:3.0:1787560571.522554:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560571.522564:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb800, rc 0) 00000100:00100000:3.0:1787560571.522660:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:11539:x1874392788324096:12345-192.168.201.56@tcp:101:cat.0 Request processed in 2501us (2838us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787560571.522670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 197 00000100:00100000:2.0:1787560571.528142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.528419:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788324352 00000100:00100000:3.0:1787560571.528432:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788324352 00000100:00100000:3.0:1787560571.528505:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:3.0:1787560571.528518:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:11539:x1874392788324352:12345-192.168.201.56@tcp:35:cat.0 00000100:00100000:3.0:1787560571.528943:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+38:11539:x1874392788324352:12345-192.168.201.56@tcp:35:cat.0 Request processed in 424us (810us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787560571.528950:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:0.0:1787560571.564104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.564707:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788324608 00000100:00100000:3.0:1787560571.564723:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788324608 00000100:00100000:3.0:1787560571.564819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 198 00000100:00100000:3.0:1787560571.564832:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+38:11540:x1874392788324608:12345-192.168.201.56@tcp:36:rm.0 00010000:00010000:3.0:1787560571.564955:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787560571.564989:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925d4 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.565043:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fc7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925cd expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.565056:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673fc42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925bf expref: 36 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.565067:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:3.0:1787560571.565079:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560571.565118:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.565133:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.565144:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.565158:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.565164:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.565170:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.566732:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fcc0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.566755:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fcc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.566768:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fcc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560571.570759:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1787560571.570788:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400323939580ns, next at 401323934426ns, rc = 0 00010000:00010000:3.0:1787560571.570936:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.570956:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.570992:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571012:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571026:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571034:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571067:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560571.571096:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fcc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571103:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fcc0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571111:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fcc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571117:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560571.571122:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fcc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571130:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fcc0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571146:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269000) 00010000:00010000:3.0:1787560571.571149:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787560571.571155:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560571.571160:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fcc0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.571162:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571168:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fcc0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.571169:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eaa00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560571.571173:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.571179:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.571188:0:7629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff93d9a1269000) 00010000:00010000:1.0:1787560571.571190:0:7629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787560571.571193:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.571199:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fcc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571207:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571213:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcb2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.571215:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560571.571217:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560571.571219:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.571219:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560571.571224:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560571.571226:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571232:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571241:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560571.571243:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560571.571246:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.571252:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560571.571265:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034463c2b reply state 00000000dbf4cb90 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560571.571289:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560571.571650:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+37:11540:x1874392788324608:12345-192.168.201.56@tcp:36:rm.0 Request processed in 6812us (7556us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787560571.571661:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 198 00010000:00010000:1.0:1787560571.573619:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.573639:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.573665:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.573671:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560571.573676:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.573685:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.573704:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d9a1269200) 00010000:00010000:1.0:1787560571.573707:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560571.573712:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.573718:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fcb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560571.613296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560571.613593:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788324864 00000100:00100000:2.0:1787560571.613611:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788324864 00000100:00100000:2.0:1787560571.613696:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 199 00000100:00100000:2.0:1787560571.613710:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+36:11546:x1874392788324864:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1787560571.613754:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560571.613792:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673fcce lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925db expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.614284:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fcd5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.614305:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fcd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.614319:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fcd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.614336:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.614360:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.614367:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560571.626282:0:6706:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787560571.628393:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.629913:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.629931:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.630020:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fcd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.630028:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fcd5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.630036:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fcd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.630043:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560571.630049:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fcd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.630058:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fcd5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.630100:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:2.0:1787560571.630103:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560571.630108:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fcd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.630115:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05673fcd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560571.630136:0:6706:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000414e5bba reply state 00000000154a1418 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560571.630146:0:6706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787560571.630206:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b05673fcce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925db expref: 39 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.630221:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925db expref: 38 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.630229:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fffe00) 00010000:00010000:2.0:1787560571.630232:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560571.630235:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710600, rc 0) 00000100:00100000:2.0:1787560571.630350:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+39:11546:x1874392788324864:12345-192.168.201.56@tcp:101:bash.0 Request processed in 16642us (17070us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787560571.630360:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 199 00010000:00010000:1.0:1787560571.633463:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.633487:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.633496:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.633503:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560571.633509:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.633661:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.633683:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fffa00) 00010000:00010000:1.0:1787560571.633687:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560571.633693:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.633700:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710800/0xe34191b05673fcdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560571.634493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560571.635088:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788324992 00000100:00100000:2.0:1787560571.635104:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788324992 00000100:00100000:2.0:1787560571.635183:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:2.0:1787560571.635196:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788324992:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1787560571.635235:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560571.635275:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4443af6/0xe34191b05673fcf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925e2 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560571.635311:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787560571.635339:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1787560571.635345:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560571.635357:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4443af6/0xe34191b05673fcf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e2 expref: 6 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.635381:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a4443af6/0xe34191b05673fcf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e2 expref: 6 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.635396:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711200, rc 0) 00000100:00100000:2.0:1787560571.635472:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2342:x1874392788324992:12345-192.168.201.56@tcp:101:bash.0 Request processed in 277us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560571.635480:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:2.0:1787560571.639511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560571.639765:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788325120 00000100:00100000:0.0:1787560571.639788:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788325120 00000100:00100000:0.0:1787560571.639869:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:0.0:1787560571.639882:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:11546:x1874392788325120:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560571.639906:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560571.639931:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925e9 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.639976:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4443af6/0xe34191b05673fcf1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e2 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.639987:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560571.639993:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560571.639999:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.640059:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4443af6/0xe34191b05673fcf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e2 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.640077:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4443af6/0xe34191b05673fcf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e2 expref: 7 pid: 6683 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560571.640120:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bad4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1874392815580032:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560571.640251:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9884e1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560571.644802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560571.645061:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788325248 00000100:00100000:2.0:1787560571.645083:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788325248 00010000:00010000:2.0:1787560571.645144:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4443af6/0xe34191b05673fcf1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e2 expref: 8 pid: 6683 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560571.645198:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:2.0:1787560571.645210:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788325248:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560571.645229:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560571.645468:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4443af6/0xe34191b05673fcf1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e2 expref: 8 pid: 6683 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.645488:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4443af6/0xe34191b05673fcf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e2 expref: 8 pid: 6683 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.645522:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560571.645528:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560571.645538:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.645551:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.645599:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560571.645619:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5824:1874392815580160:192.168.201.56@tcp:105: 00000100:00100000:2.0:1787560571.645726:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bad68840 going to sleep for 11 seconds 00010000:00010000:0.0:1787560571.646740:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4443af6/0xe34191b05673fcf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e2 expref: 8 pid: 6683 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560571.646762:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bad4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6685:1874392815580032:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560571.646808:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560571.646823:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100200, rc 0) 00000100:00100000:0.0:1787560571.646964:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:11546:x1874392788325120:12345-192.168.201.56@tcp:101:bash.0 Request processed in 7083us (7467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560571.646974:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:3.0:1787560571.648507:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5824:1874392815580160:192.168.201.56@tcp:105: 00010000:00010000:3.0:1787560571.648541:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560571.648600:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2343:x1874392788325248:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 3392us (3815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560571.648611:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:1.0:1787560571.650107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.650226:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788325504 00000100:00100000:3.0:1787560571.650239:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788325504 00000100:00100000:3.0:1787560571.650307:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:3.0:1787560571.650318:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+38:11546:x1874392788325504:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:3.0:1787560571.650764:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+39:11546:x1874392788325504:12345-192.168.201.56@tcp:35:bash.0 Request processed in 446us (663us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787560571.650782:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 55 00010000:00010000:3.0:1787560571.663244:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560571.860732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.860905:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788325632 00000100:00100000:3.0:1787560571.860918:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788325632 00000100:00100000:3.0:1787560571.860998:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 200 00000100:00100000:3.0:1787560571.861011:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+39:11562:x1874392788325632:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560571.861056:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560571.861279:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.861397:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fd06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.861415:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fd06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.861428:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fd06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560571.861506:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787560571.861510:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560571.861539:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fd06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.861572:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fcff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925f0 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.861603:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fd06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925f0 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.861613:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560571.861616:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560571.861620:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea400, rc 0) 00000100:00100000:3.0:1787560571.861710:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+40:11562:x1874392788325632:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 701us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560571.861720:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 200 00000100:00100000:2.0:1787560571.868423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.868560:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788325888 00000100:00100000:3.0:1787560571.868574:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788325888 00000100:00100000:3.0:1787560571.868732:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 201 00000100:00100000:3.0:1787560571.868746:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+40:11562:x1874392788325888:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560571.868784:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560571.868813:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fd0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925f7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.868977:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.868995:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.869010:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560571.869036:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787560571.869225:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fd0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925f7 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.869259:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925f7 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.869269:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fffe00) 00010000:00010000:3.0:1787560571.869273:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560571.869277:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb800, rc 0) 00000100:00100000:3.0:1787560571.869366:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+42:11562:x1874392788325888:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 623us (960us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787560571.869375:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 201 00000100:00100000:1.0:1787560571.879551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.880311:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788326016 00000100:00100000:3.0:1787560571.880347:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788326016 00000100:00100000:3.0:1787560571.880440:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:3.0:1787560571.880454:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+42:2342:x1874392788326016:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560571.880477:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560571.880509:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925f7 expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.880537:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fffe00) 00010000:00010000:3.0:1787560571.880543:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560571.880617:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+41:2342:x1874392788326016:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 166us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560571.880626:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:0.0:1787560571.886380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.886952:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788326272 00000100:00100000:3.0:1787560571.886965:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788326272 00000100:00100000:3.0:1787560571.887056:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 202 00000100:00100000:3.0:1787560571.887079:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+41:11562:x1874392788326272:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560571.887299:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560571.887328:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf925fe expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.887465:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fd29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.887483:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fd29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.887498:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fd29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560571.887533:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787560571.887705:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925fe expref: 44 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.887729:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fd29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925fe expref: 43 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.887740:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fffe00) 00010000:00010000:3.0:1787560571.887743:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787560571.887747:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea800, rc 0) 00000100:00100000:3.0:1787560571.888207:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+43:11562:x1874392788326272:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1139us (1841us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787560571.888217:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 202 00000100:00100000:0.0:1787560571.909674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560571.909801:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788326400 00000100:00100000:2.0:1787560571.909815:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788326400 00000100:00100000:2.0:1787560571.909938:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:2.0:1787560571.909952:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+6:2345:x1874392788326400:12345-192.168.201.56@tcp:1:lfs.0 00010000:00010000:2.0:1787560571.910016:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.910084:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.910170:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560571.910176:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560571.910182:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.910234:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.910252:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 6 pid: 6685 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560571.910272:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874392815580288:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560571.910384:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bad68480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560571.915442:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6683:1874392815580288:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560571.915487:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560571.918062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.925972:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788326528 00000100:00100000:3.0:1787560571.925996:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788326528 00002000:00100000:2.0:1787560571.933109:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93d9bad4d180 x1874392788326528/t0(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:687/0 lens 504/0 e 0 to 0 dl 1787560582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560571.933129:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9bad4d180 with x1874392788326528 ext(0->8) 00010000:00010000:2.0:1787560571.933143:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 7 pid: 6685 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.933183:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 7 pid: 6685 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560571.933193:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93d9bad4d180 00000100:00100000:2.0:1787560571.933253:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:2.0:1787560571.933265:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788326528:12345-192.168.201.56@tcp:4:lfs.0 00000100:00100000:2.0:1787560571.933949:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2342:x1874392788326528:12345-192.168.201.56@tcp:4:lfs.0 Request processed in 682us (15897us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787560571.933960:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 3 00002000:00100000:2.0:1787560571.933969:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff93d9bad4d180 x1874392788326528/t4294967308(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:687/0 lens 504/448 e 0 to 0 dl 1787560582 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787560571.933979:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9bad4d180 with x1874392788326528 ext(0->8) 00010000:00010000:2.0:1787560571.933987:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 9 pid: 6685 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.934002:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 9 pid: 6685 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560571.934010:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93d9bad4d180 00000100:00100000:1.0:1787560571.937646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560571.937756:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788326656 00000100:00100000:2.0:1787560571.937780:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788326656 00010000:00010000:2.0:1787560571.937836:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 9 pid: 6685 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560571.937932:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 77 00000100:00100000:2.0:1787560571.937943:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2342:x1874392788326656:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560571.937964:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787560571.937989:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787560571.937993:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787560571 00002000:00010000:2.0:1787560571.937996:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787560572 00002000:00010000:2.0:1787560571.937998:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787560571 00010000:00010000:2.0:1787560571.938005:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 9 pid: 6685 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.938245:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 9 pid: 6685 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.938276:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b05673fcf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925e9 expref: 9 pid: 6685 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.938298:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560571.938303:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560571.938309:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.938321:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.938408:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560571.938494:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2342:x1874392788326656:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 552us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560571.938503:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 77 00010000:00010000:1.0:1787560571.945257:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.945286:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.945342:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.945351:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.945360:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.945393:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710e00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560571.945400:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.945410:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.945436:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.945445:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024e9b99a/0xe34191b05673fd37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560571.945643:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2345:x1874392788326400:12345-192.168.201.56@tcp:1:lfs.0 Request processed in 35686us (35976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560571.945655:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:1.0:1787560571.953668:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.953760:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788326912 00000100:00100000:3.0:1787560571.953783:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788326912 00000100:00100000:3.0:1787560571.953903:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:3.0:1787560571.953916:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae744c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+43:11562:x1874392788326912:12345-192.168.201.56@tcp:35:lfs.0 00000004:00010000:3.0:1787560571.954005:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fd29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925fe expref: 43 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560571.954597:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787560571.954646:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787560571.955287:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787560571.955364:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.955413:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925db expref: 47 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.955424:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.955478:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925db expref: 47 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.955500:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925db expref: 47 pid: 6706 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560571.955519:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d998b71500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1874392815580416:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560571.955657:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987f520c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560571.959931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560571.960047:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788327040 00000100:00100000:3.0:1787560571.960060:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788327040 00010000:00010000:3.0:1787560571.960128:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925db expref: 48 pid: 6706 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560571.960182:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:3.0:1787560571.960196:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+48:2343:x1874392788327040:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560571.960220:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560571.960229:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925db expref: 48 pid: 6706 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.960245:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925db expref: 48 pid: 6706 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.960303:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fffe00) 00010000:00010000:3.0:1787560571.960310:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.960322:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.960330:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560571.960354:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560571.960427:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+48:2343:x1874392788327040:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 234us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560571.960448:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 78 00010000:00010000:1.0:1787560571.961532:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710600/0xe34191b05673fce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925db expref: 47 pid: 6706 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560571.961563:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d998b71500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1874392815580416:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560571.961596:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.961607:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.961627:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787560571.961809:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787560571.962117:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787560571.962270:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815580544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787560571.962348:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560571.962390:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998480540 going to sleep for 11 seconds 00000100:00100000:0.0:1787560571.962633:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815580544 00000100:00100000:0.0:1787560571.962642:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815580544 00000100:00100000:0.0:1787560571.962709:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560571.962720:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874392815580544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787560571.962866:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874392815580544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 126us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560571.962881:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560571.963386:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787560571.963394:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1787560571.963417:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d9bab95880, transno 4294967307 00000100:00100000:1.0:1787560571.963437:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815580544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787560571.967254:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787560571.967576:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815580672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787560571.967670:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560571.967709:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560571.967822:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815580672 00000100:00100000:0.0:1787560571.967833:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815580672 00000100:00100000:0.0:1787560571.967934:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560571.967947:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1874392815580672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787560571.968214:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1874392815580672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 269us (542us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787560571.968224:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560571.969226:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1874392815580672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787560571.969606:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787560571.969681:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.969694:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.969703:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.969710:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560571.969733:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.969742:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.969762:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fffe00) 00010000:00010000:1.0:1787560571.969777:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787560571.969782:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560571.969789:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb800/0xe34191b05673fd3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787560571.970433:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787560571.970558:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787560571.970572:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400723723867ns, next at 401723721232ns, rc = 0 00000001:00080000:1.0:1787560571.970581:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787560571.970629:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fffe00) 00010000:00010000:1.0:1787560571.970633:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787560571.970641:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05673fd29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925fe expref: 51 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560571.970822:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae744c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+50:11562:x1874392788326912:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 16907us (17169us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787560571.970834:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 56 00000020:00080000:1.0:1787560571.970841:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787560571.974087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560571.974382:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788327168 00000100:00100000:2.0:1787560571.974395:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788327168 00000100:00100000:2.0:1787560571.974466:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 203 00000100:00100000:2.0:1787560571.974479:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+50:11562:x1874392788327168:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560571.974512:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560571.974544:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673fd45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92605 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.974631:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673fd45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92605 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.974647:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673fd45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92605 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560571.974670:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:2.0:1787560571.974673:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560571.974678:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711800, rc 0) 00000100:00100000:2.0:1787560571.974759:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+51:11562:x1874392788327168:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 282us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560571.974776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 203 00000100:00100000:2.0:1787560571.982010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560571.982217:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788327424 00000100:00100000:1.0:1787560571.982231:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788327424 00000100:00100000:1.0:1787560571.982325:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:1.0:1787560571.982339:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+51:11562:x1874392788327424:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:1.0:1787560571.982676:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:11562:x1874392788327424:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 339us (678us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787560571.982684:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:3.0:1787560572.087640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560572.087724:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788327552 00000100:00100000:0.0:1787560572.087738:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788327552 00000100:00100000:0.0:1787560572.087833:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 204 00000100:00100000:0.0:1787560572.088071:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:11572:x1874392788327552:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:0.0:1787560572.088192:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673fd4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088215:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673fd4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088229:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673fd4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088246:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088254:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088268:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088421:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088430:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088450:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560572.088504:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088521:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673fd4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088528:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673fd4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088535:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673fd4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088542:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560572.088547:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673fd4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088554:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673fd4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088568:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560572.088572:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560572.088577:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673fd4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088590:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100400/0xe34191b05673fd4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088607:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088613:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088618:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088622:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560572.088624:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088628:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088633:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d987fb3c00) 00010000:00010000:0.0:1787560572.088635:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560572.088637:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088641:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088653:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088656:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088664:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088667:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560572.088669:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088672:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088676:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:0.0:1787560572.088678:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560572.088679:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.088682:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560572.088776:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:11572:x1874392788327552:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 922us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560572.088783:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 204 00000100:00100000:0.0:1787560572.131552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.131747:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788327808 00000100:00100000:3.0:1787560572.131759:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788327808 00000100:00100000:3.0:1787560572.131927:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 205 00000100:00100000:3.0:1787560572.131940:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+52:11575:x1874392788327808:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560572.131968:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560572.131997:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fd61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9260c expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132116:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fd68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132135:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fd68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132175:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fd68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132193:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fd6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132201:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fd6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132209:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fd6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132392:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132403:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132410:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560572.132422:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787560572.132719:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fd68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132728:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fd68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132735:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fd68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132741:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eaa00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560572.132754:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fd68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132762:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fd68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132786:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560572.132790:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560572.132796:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fd68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132803:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fd68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132825:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fd6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132832:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fd6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132839:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fd6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132844:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebe00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560572.132968:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fd6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132975:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fd6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.132984:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d9a1269700) 00010000:00010000:3.0:1787560572.132986:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560572.132997:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fd6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.133003:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fd6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.133076:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fd61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9260c expref: 55 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.133093:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9260c expref: 54 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.133102:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:3.0:1787560572.133105:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560572.133108:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea600, rc 0) 00000100:00100000:3.0:1787560572.133204:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:11575:x1874392788327808:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1266us (1667us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787560572.133213:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 205 00000100:00100000:2.0:1787560572.138011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.138366:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788327936 00000100:00100000:1.0:1787560572.138379:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788327936 00000100:00100000:1.0:1787560572.138501:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 206 00000100:00100000:1.0:1787560572.138514:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:11575:x1874392788327936:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:1.0:1787560572.138618:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fd84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.138639:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fd84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.138652:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fd84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.138685:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fd84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.138692:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fd84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.138700:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fd84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.138708:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560572.138713:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fd84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.138721:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fd84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.138755:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:1.0:1787560572.138759:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560572.138775:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fd84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.138782:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05673fd84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560572.138915:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:11575:x1874392788327936:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 404us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.138923:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 206 00000100:00100000:1.0:1787560572.143160:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.143663:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788328192 00000100:00100000:3.0:1787560572.143678:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788328192 00000100:00100000:3.0:1787560572.143754:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:3.0:1787560572.143778:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+54:11575:x1874392788328192:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:3.0:1787560572.144581:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:11575:x1874392788328192:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 813us (1434us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787560572.144593:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:2.0:1787560572.230827:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560572.231432:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788328448 00000100:00100000:0.0:1787560572.231446:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788328448 00000100:00100000:0.0:1787560572.231530:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 207 00000100:00100000:0.0:1787560572.231545:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:11585:x1874392788328448:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560572.231581:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560572.231586:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787560572.231624:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05673fd06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925f0 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.231668:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560572.231676:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560572.231696:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92613 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.231927:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.231943:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9260c expref: 55 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.231953:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.231998:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9260c expref: 55 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.232032:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9260c expref: 55 pid: 6706 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560572.232051:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bad4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874392815580800:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560572.232176:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9884e1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560572.237203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560572.237557:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bad4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1874392815580800:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560572.237595:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.237992:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788328576 00000100:00100000:3.0:1787560572.238001:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788328576 00010000:00010000:3.0:1787560572.238193:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9260c expref: 56 pid: 6706 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.238424:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00100000:3.0:1787560572.238437:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+56:2342:x1874392788328576:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560572.238455:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560572.238463:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9260c expref: 56 pid: 6706 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.238477:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9260c expref: 56 pid: 6706 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.238503:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fd76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9260c expref: 56 pid: 6706 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.238525:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:3.0:1787560572.238531:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.238541:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.238549:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.238582:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560572.238657:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:2342:x1874392788328576:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 222us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.238666:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 79 00010000:00010000:0.0:1787560572.238726:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.238742:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560572.239008:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787560572.239267:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100800/0xe34191b05673fd8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92613 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.239289:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92613 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560572.239297:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:0.0:1787560572.239300:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787560572.239303:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101600, rc 0) 00000100:00100000:0.0:1787560572.239371:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:11585:x1874392788328448:12345-192.168.201.56@tcp:101:bash.0 Request processed in 7830us (8565us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787560572.239380:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 207 00000100:00100000:2.0:1787560572.244172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.244447:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788328832 00000100:00100000:3.0:1787560572.244468:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788328832 00000100:00100000:3.0:1787560572.244603:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 208 00000100:00100000:3.0:1787560572.244617:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+55:11585:x1874392788328832:12345-192.168.201.56@tcp:36:bash.0 00010000:00010000:3.0:1787560572.245228:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.245394:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.245411:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787560572.245490:0:6706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787560572.245523:0:6706:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d8a8169 reply state 000000002d8d4d35 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.245533:0:6706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560572.245726:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11585:x1874392788328832:12345-192.168.201.56@tcp:36:bash.0 Request processed in 1109us (1566us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787560572.245735:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 208 00000020:00080000:3.0:1787560572.245742:0:6706:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787560572.250629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:2.0:1787560572.250686:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.250702:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.250711:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.250718:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560572.250724:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.250733:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.250770:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:2.0:1787560572.250773:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560572.250779:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.250783:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788328960 00010000:00010000:2.0:1787560572.250785:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb600/0xe34191b05673fda0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.250795:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788328960 00000100:00100000:2.0:1787560572.250902:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 209 00000100:00100000:2.0:1787560572.250985:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11585:x1874392788328960:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1787560572.251347:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560572.251375:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673fda7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9261a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.251490:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.251524:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92613 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.251533:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.251577:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92613 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.251596:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92613 expref: 58 pid: 5838 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560572.251613:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815580928:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560572.251730:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bad68480 going to sleep for 11 seconds 00000100:00100000:2.0:1787560572.255797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.255827:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815580928:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560572.256388:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788329088 00000100:00100000:3.0:1787560572.256398:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788329088 00010000:00010000:3.0:1787560572.256449:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92613 expref: 59 pid: 5838 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.256493:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00100000:3.0:1787560572.256505:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:2343:x1874392788329088:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560572.256547:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560572.256554:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92613 expref: 59 pid: 5838 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.256625:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92613 expref: 59 pid: 5838 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.256648:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fd92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92613 expref: 59 pid: 5838 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.256664:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:3.0:1787560572.256668:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.256677:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.256683:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.256699:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560572.256772:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:2343:x1874392788329088:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 260us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.256780:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 80 00010000:00010000:1.0:1787560572.256841:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.256870:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.256877:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560572.256944:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787560572.256949:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560572.256976:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.257031:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711a00/0xe34191b05673fda7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9261a expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.257061:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9261a expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.257070:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:1.0:1787560572.257073:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787560572.257076:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711e00, rc 0) 00000100:00100000:1.0:1787560572.257120:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11585:x1874392788328960:12345-192.168.201.56@tcp:101:bash.0 Request processed in 6142us (6508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.257128:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 209 00000100:00100000:2.0:1787560572.261403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.261459:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788329344 00000100:00100000:1.0:1787560572.261473:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788329344 00000100:00100000:1.0:1787560572.261544:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:1.0:1787560572.261554:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+57:11585:x1874392788329344:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:1.0:1787560572.261893:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11585:x1874392788329344:12345-192.168.201.56@tcp:35:bash.0 Request processed in 339us (505us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787560572.261903:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:0.0:1787560572.315544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.315663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788329472 00000100:00100000:3.0:1787560572.315678:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788329472 00000100:00100000:3.0:1787560572.315748:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 210 00000100:00100000:3.0:1787560572.315757:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+58:11591:x1874392788329472:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560572.315831:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560572.315950:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fdb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92621 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.316393:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fdbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.316413:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fdbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.316429:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fdbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560572.316514:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787560572.316519:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560572.316548:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fdbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.316584:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fdb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92621 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.316615:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fdbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92621 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.316626:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560572.316629:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560572.316634:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ebe00, rc 0) 00000100:00100000:3.0:1787560572.316724:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11591:x1874392788329472:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 967us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.316733:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 210 00000100:00100000:0.0:1787560572.319421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.319540:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788329600 00000100:00100000:3.0:1787560572.319550:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788329600 00000100:00100000:3.0:1787560572.319611:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 211 00000100:00100000:3.0:1787560572.319620:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11591:x1874392788329600:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560572.319642:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560572.319661:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92628 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.319726:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fdca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.319740:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fdca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.319749:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fdca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.319773:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fdd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.319782:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.319789:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.319954:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fdd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.319964:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.319983:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560572.321235:0:6706:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787560572.321243:0:6706:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560572.321392:0:6706:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321410:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fdd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321418:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fdca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321423:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fdca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321429:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fdca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321433:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560572.321437:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fdca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321442:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fdca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321456:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560572.321458:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560572.321461:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fdca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321482:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fdca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321502:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fdd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321505:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fdd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321509:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fdd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321512:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560572.321514:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fdd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321517:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fdd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321521:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d9a1269700) 00010000:00010000:3.0:1787560572.321522:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560572.321524:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fdd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321527:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fdd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321566:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92628 expref: 61 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321577:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fdd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92628 expref: 60 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.321587:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:3.0:1787560572.321589:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560572.321590:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb000, rc 0) 00000100:00100000:3.0:1787560572.321666:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:11591:x1874392788329600:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 2046us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.321674:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 211 00000100:00100000:2.0:1787560572.327718:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.327835:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788329728 00000100:00100000:1.0:1787560572.327873:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788329728 00000100:00100000:1.0:1787560572.327959:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:1.0:1787560572.327969:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9adaad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:2343:x1874392788329728:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560572.327987:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560572.328033:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b05673fdd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92628 expref: 60 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.328063:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:1.0:1787560572.328086:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560572.328155:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9adaad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:2343:x1874392788329728:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 186us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.328162:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:0.0:1787560572.328716:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.328882:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788329984 00000100:00100000:1.0:1787560572.328890:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788329984 00000100:00100000:1.0:1787560572.328930:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 212 00000100:00100000:1.0:1787560572.328940:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11591:x1874392788329984:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560572.328962:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560572.328985:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9262f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.329149:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.329167:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9261a expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.329177:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.329220:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9261a expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.329236:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9261a expref: 60 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560572.329464:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815581056:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560572.329586:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9babcec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560572.334933:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815581056:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560572.334989:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560572.335555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560572.335639:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788330112 00000100:00100000:2.0:1787560572.335647:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788330112 00010000:00010000:2.0:1787560572.335699:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9261a expref: 61 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560572.335740:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 81 00000100:00100000:2.0:1787560572.335752:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:2342:x1874392788330112:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560572.335784:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560572.335791:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9261a expref: 61 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.335818:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9261a expref: 61 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.335840:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711e00/0xe34191b05673fdae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9261a expref: 61 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.335878:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:2.0:1787560572.335893:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.335904:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.335911:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.335934:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560572.335953:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.335960:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560572.335984:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:2.0:1787560572.336005:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:2342:x1874392788330112:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 255us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560572.336022:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 81 00010000:00010000:1.0:1787560572.336200:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9262f expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.336219:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9262f expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.336227:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:1.0:1787560572.336230:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560572.336233:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260400, rc 0) 00000100:00100000:1.0:1787560572.339046:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:11591:x1874392788329984:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 10079us (10303us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787560572.339066:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 212 00000100:00100000:0.0:1787560572.343488:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.345976:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788330368 00000100:00100000:1.0:1787560572.345996:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788330368 00000100:00100000:1.0:1787560572.346114:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:1.0:1787560572.346128:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:11591:x1874392788330368:12345-192.168.201.56@tcp:103:lfs.0 00010000:00010000:1.0:1787560572.346173:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560572.346206:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b05673fd45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92605 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.346234:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:1.0:1787560572.346239:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560572.346315:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11591:x1874392788330368:12345-192.168.201.56@tcp:103:lfs.0 Request processed in 191us (2845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.346323:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:0.0:1787560572.351025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.352228:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788330496 00000100:00100000:1.0:1787560572.352249:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788330496 00000100:00100000:1.0:1787560572.352511:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 213 00000100:00100000:1.0:1787560572.352525:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11591:x1874392788330496:12345-192.168.201.56@tcp:58:lfs.0 00010000:00010000:1.0:1787560572.353229:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.353744:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.353842:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560572.354585:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787560572.355421:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11591:x1874392788330496:12345-192.168.201.56@tcp:58:lfs.0 Request processed in 2890us (4413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.355437:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 213 00000100:00100000:0.0:1787560572.358934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.359108:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788330624 00000100:00100000:3.0:1787560572.359123:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788330624 00000100:00100000:3.0:1787560572.359318:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 214 00000100:00100000:3.0:1787560572.359393:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+59:11591:x1874392788330624:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560572.359420:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560572.359445:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92636 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.359517:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.359529:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdfb lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92636 expref: 60 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.359551:0:6706:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.359565:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdfb lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92636 expref: 60 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.359581:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:3.0:1787560572.359603:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560572.359609:0:6706:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdfb lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92636 expref: 60 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.359617:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eaa00, rc 0) 00000100:00100000:3.0:1787560572.359751:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:11591:x1874392788330624:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 361us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.359768:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 214 00000040:00080000:1.0:1787560572.687192:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560572.687210:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560572.687297:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787560572.687308:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787560572.687496:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0ff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815581184:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787560572.687647:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9babcec00 going to sleep for 11 seconds 00010000:00010000:1.0:1787560572.688471:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560572.700786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560572.707094:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788330752 00000100:00100000:2.0:1787560572.707115:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788330752 00000100:00100000:2.0:1787560572.707215:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 215 00000100:00100000:2.0:1787560572.707230:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11593:x1874392788330752:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787560572.707278:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787560572.707439:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11593:x1874392788330752:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 212us (6668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560572.707477:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 215 00000100:00100000:1.0:1787560572.709979:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0ff480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815581184:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787560572.713970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.714212:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788330880 00000100:00100000:1.0:1787560572.714226:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788330880 00000100:00100000:1.0:1787560572.714315:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 216 00000100:00100000:1.0:1787560572.714330:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:11593:x1874392788330880:12345-192.168.201.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787560572.714432:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe02 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714464:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714478:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714497:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714506:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714512:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714540:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714570:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714578:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560572.714627:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787560572.714632:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560572.714648:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714661:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714669:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe02 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714677:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714685:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560572.714690:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714698:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe02 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714713:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:1.0:1787560572.714716:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560572.714722:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714739:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714769:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714777:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe09 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714783:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714789:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560572.714793:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714800:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe09 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714807:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff93d995c27f00) 00010000:00010000:1.0:1787560572.714810:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560572.714813:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe09 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714820:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714837:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714842:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714895:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714901:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560572.714905:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714912:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714921:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:1.0:1787560572.714923:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560572.714927:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.714933:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560572.715037:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:11593:x1874392788330880:12345-192.168.201.56@tcp:34:lhsmtool_posix.0 Request processed in 709us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.715047:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 216 00000100:00100000:0.0:1787560572.724390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.724494:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788331136 00000100:00100000:3.0:1787560572.724507:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788331136 00000100:00100000:3.0:1787560572.724586:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 217 00000100:00100000:3.0:1787560572.724599:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+60:11593:x1874392788331136:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560572.724626:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560572.724652:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9263d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.724792:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.724810:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.724825:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560572.724838:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787560572.726133:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.726151:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.726177:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.726184:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560572.726189:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.726205:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.726225:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:3.0:1787560572.726228:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787560572.726234:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.726241:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.726314:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe17 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9263d expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.726327:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:3.0:1787560572.726330:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560572.726334:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9263d expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.726349:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eba00, rc 0) 00000100:00100000:3.0:1787560572.726431:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11593:x1874392788331136:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 1833us (2055us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787560572.726451:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 217 00000100:00100000:0.0:1787560572.729176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.731211:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788331264 00000100:00100000:3.0:1787560572.731234:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788331264 00000100:00100000:3.0:1787560572.731331:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 218 00000100:00100000:3.0:1787560572.731344:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11593:x1874392788331264:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787560572.731407:0:11858:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787560572.731546:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11593:x1874392788331264:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 205us (2384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.731555:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 218 00000100:00100000:0.0:1787560572.737336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.737937:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788331520 00000100:00100000:3.0:1787560572.737952:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788331520 00000100:00100000:3.0:1787560572.738037:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 219 00000100:00100000:3.0:1787560572.738051:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11593:x1874392788331520:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560572.738082:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560572.738086:0:6706:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787560572.738122:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673fdbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92621 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.738155:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560572.738161:0:6706:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560572.738180:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92644 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787560572.738748:0:6706:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1787560572.739029:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673fe33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.739063:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673fe33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.739075:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673fe33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.739139:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92644 expref: 63 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.739160:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673fe33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92644 expref: 62 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.739168:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:3.0:1787560572.739171:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560572.739175:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ebc00, rc 0) 00000100:00100000:3.0:1787560572.739256:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+62:11593:x1874392788331520:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 1208us (1935us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787560572.739264:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 219 00000100:00100000:0.0:1787560572.744295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.746900:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788331776 00000100:00100000:3.0:1787560572.746921:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788331776 00000100:00100000:3.0:1787560572.747143:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 220 00000100:00100000:3.0:1787560572.747159:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+62:11593:x1874392788331776:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787560572.747247:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560572.747281:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b05673fe33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92644 expref: 62 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747314:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d9a1269700) 00010000:00010000:3.0:1787560572.747346:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560572.747386:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747403:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747414:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747433:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x27164570 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747440:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x27164570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747448:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x27164570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747547:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747555:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747561:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747568:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560572.747572:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747580:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747598:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:3.0:1787560572.747601:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560572.747605:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747611:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747622:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x27164570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747628:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27164570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747633:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27164570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747638:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560572.747641:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27164570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747648:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x27164570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747655:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x27164570 (ffff93d9a1269200) 00010000:00010000:3.0:1787560572.747657:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560572.747660:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x27164570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.747665:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x27164570 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.747807:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11593:x1874392788331776:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 651us (3527us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560572.756692:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 220 00000100:00100000:0.0:1787560572.756943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.757038:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788331904 00000100:00100000:1.0:1787560572.757052:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788331904 00000100:00100000:1.0:1787560572.757118:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 221 00000100:00100000:1.0:1787560572.757131:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+61:11593:x1874392788331904:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560572.757159:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560572.757189:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9264b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.757255:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.757271:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.757283:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.757577:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9264b expref: 63 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.757601:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9264b expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.757612:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:1.0:1787560572.757616:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787560572.757620:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261800, rc 0) 00000100:00100000:1.0:1787560572.757748:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+62:11593:x1874392788331904:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 620us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.757765:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 221 00000100:00100000:0.0:1787560572.765963:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.766072:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788332160 00000100:00100000:1.0:1787560572.766088:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788332160 00000100:00100000:1.0:1787560572.766175:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 222 00000100:00100000:1.0:1787560572.766188:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+62:11593:x1874392788332160:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787560572.766306:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.766350:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.766380:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560572.766708:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787560572.766719:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401519870608ns, next at 402519868096ns, rc = 0 00000004:00010000:1.0:1787560572.766841:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056d374fb reply state 00000000e33210bb transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560572.766882:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560572.767018:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+64:11593:x1874392788332160:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 830us (1069us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787560572.767027:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 222 00010000:00010000:1.0:1787560572.772533:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.772557:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.772565:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.772572:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560572.772578:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.772586:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.772635:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:1.0:1787560572.772639:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787560572.772646:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.772653:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673fe5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560572.772970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.773243:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788332288 00000100:00100000:1.0:1787560572.773256:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788332288 00000100:00100000:1.0:1787560572.773338:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 223 00000100:00100000:1.0:1787560572.773351:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+63:11593:x1874392788332288:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560572.773393:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560572.773416:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92652 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.773496:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92652 expref: 64 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.773513:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92652 expref: 64 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.773536:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:1.0:1787560572.773540:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560572.773542:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260000, rc 0) 00000100:00100000:1.0:1787560572.773670:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+64:11593:x1874392788332288:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 321us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.773693:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 223 00000100:00100000:0.0:1787560572.779581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560572.779675:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788332416 00000100:00100000:2.0:1787560572.779689:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788332416 00000100:00100000:2.0:1787560572.779794:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:2.0:1787560572.779807:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2343:x1874392788332416:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787560572.780339:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560572.780440:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:2343:x1874392788332416:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 Request processed in 633us (873us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787560572.780451:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:3.0:1787560572.783454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.783630:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788332672 00000100:00100000:1.0:1787560572.783643:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788332672 00000100:00100000:1.0:1787560572.783723:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:1.0:1787560572.783737:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+64:11593:x1874392788332672:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787560572.784116:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+65:11593:x1874392788332672:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 382us (675us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787560572.784125:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:0.0:1787560572.788815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.788976:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788332928 00000100:00100000:3.0:1787560572.788991:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788332928 00000100:00100000:3.0:1787560572.789070:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 224 00000100:00100000:3.0:1787560572.789082:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+65:11593:x1874392788332928:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787560572.789245:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+65:11593:x1874392788332928:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 164us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.789254:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 224 00000100:00100000:0.0:1787560572.791470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.791577:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788333056 00000100:00100000:3.0:1787560572.791589:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788333056 00000100:00100000:3.0:1787560572.791701:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 225 00000100:00100000:3.0:1787560572.791713:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+65:11593:x1874392788333056:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560572.791739:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560572.791778:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92659 expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.791920:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.791938:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.791952:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560572.792028:0:11858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560572.792054:0:11858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.792087:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea200/0xe34191b05673fe6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92659 expref: 67 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.792113:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92659 expref: 66 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.792124:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:3.0:1787560572.792128:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787560572.792132:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eba00, rc 0) 00000100:00100000:3.0:1787560572.792199:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+66:11593:x1874392788333056:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 487us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.792207:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 225 00000100:00100000:0.0:1787560572.796254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.796346:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788333184 00000100:00100000:3.0:1787560572.796360:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788333184 00000100:00100000:3.0:1787560572.796441:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:3.0:1787560572.796453:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98a67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+10:2342:x1874392788333184:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560572.796475:0:8101:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560572.796503:0:8101:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c1b755a/0xe34191b05673fe79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92660 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560572.796538:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c027c, blocks: 0x1 00010000:00010000:3.0:1787560572.796563:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1787560572.796586:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560572.796599:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c1b755a/0xe34191b05673fe79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92660 expref: 11 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.796622:0:8101:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c1b755a/0xe34191b05673fe79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92660 expref: 11 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.796640:0:8101:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ebc00, rc 0) 00000100:00100000:3.0:1787560572.796717:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98a67e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:2342:x1874392788333184:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 266us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.796725:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:0.0:1787560572.799254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560572.799386:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788333440 00000100:00100000:2.0:1787560572.799399:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788333440 00000100:00100000:2.0:1787560572.799470:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 226 00000100:00100000:2.0:1787560572.799482:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+66:11593:x1874392788333440:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787560572.799622:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+66:11593:x1874392788333440:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 141us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560572.799632:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 226 00000100:00100000:0.0:1787560572.801922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560572.803135:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788333568 00000100:00100000:2.0:1787560572.803151:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788333568 00000100:00100000:2.0:1787560572.803287:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:2.0:1787560572.803301:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:11593:x1874392788333568:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560572.803327:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560572.803351:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92667 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.803406:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c1b755a/0xe34191b05673fe79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92660 expref: 12 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.803441:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560572.803447:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560572.803454:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 12 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.803498:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c1b755a/0xe34191b05673fe79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92660 expref: 12 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.803515:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c1b755a/0xe34191b05673fe79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92660 expref: 12 pid: 8101 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560572.803534:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815581312:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560572.803660:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bad68840 going to sleep for 11 seconds 00000100:00100000:0.0:1787560572.808688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.809453:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788333696 00000100:00100000:3.0:1787560572.809466:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788333696 00010000:00010000:3.0:1787560572.809521:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c1b755a/0xe34191b05673fe79 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92660 expref: 13 pid: 8101 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.809574:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:3.0:1787560572.809585:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:2343:x1874392788333696:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560572.809604:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560572.809633:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c1b755a/0xe34191b05673fe79 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92660 expref: 13 pid: 8101 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.809649:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c1b755a/0xe34191b05673fe79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92660 expref: 13 pid: 8101 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.809679:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560572.809700:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560572.809711:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.809781:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.809831:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 13 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.809881:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883425880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5825:1874392815581440:192.168.201.56@tcp:105: 00000100:00100000:3.0:1787560572.809986:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987f52c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560572.812563:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883425880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5825:1874392815581440:192.168.201.56@tcp:105: 00010000:00010000:3.0:1787560572.812598:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560572.812668:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:2343:x1874392788333696:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 3083us (3996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.812683:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 82 00010000:00010000:2.0:1787560572.813907:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c1b755a/0xe34191b05673fe79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92660 expref: 12 pid: 8101 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560572.813943:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815581312:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560572.813980:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.813999:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711c00, rc 0) 00000100:00100000:2.0:1787560572.814067:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:11593:x1874392788333568:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 10768us (12157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560572.814102:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:0.0:1787560572.828694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.829927:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788333824 00000100:00100000:1.0:1787560572.829944:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788333824 00002000:00100000:1.0:1787560572.830032:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff93d9bfc7e680 x1874392788333824/t0(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:688/0 lens 504/0 e 0 to 0 dl 1787560583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787560572.830046:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9bfc7e680 with x1874392788333824 ext(0->12) 00002000:00010000:1.0:1787560572.830053:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d9bfc7e680 00000100:00100000:1.0:1787560572.830093:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:1.0:1787560572.830108:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+11:2343:x1874392788333824:12345-192.168.201.56@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787560572.830734:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:2343:x1874392788333824:12345-192.168.201.56@tcp:4:lhsmtool_posix.0 Request processed in 625us (2051us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787560572.830744:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00002000:00100000:1.0:1787560572.830765:0:6689:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff93d9bfc7e680 x1874392788333824/t4294967320(0) o4->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:688/0 lens 504/448 e 0 to 0 dl 1787560583 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787560572.830774:0:6689:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9bfc7e680 with x1874392788333824 ext(0->12) 00002000:00010000:1.0:1787560572.830779:0:6689:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d9bfc7e680 00000100:00100000:0.0:1787560572.835718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560572.835814:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788333952 00000100:00100000:1.0:1787560572.835828:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788333952 00000100:00100000:1.0:1787560572.835960:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 227 00000100:00100000:1.0:1787560572.835973:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+66:11593:x1874392788333952:12345-192.168.201.56@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787560572.913658:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967498 is committed 00000001:00080000:3.0:1787560572.913688:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1787560572.913698:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1787560572.913734:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787560572.913768:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d998480c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787560572.913775:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d984354e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d998480540 00000020:00080000:3.0:1787560572.913779:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d984354500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d9bb226800 00000020:00080000:3.0:1787560572.913819:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d98357c000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787560572.913823:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d98739ac00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d98357c300 00000020:00080000:3.0:1787560572.913882:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d991ce8b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d9baba4c00 00000020:00080000:3.0:1787560572.913902:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1787560572.913943:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787560572.914148:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787560572.914380:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787560572.914407:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815581568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787560572.914496:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560572.914597:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815581568 00000100:00100000:3.0:1787560572.914607:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815581568 00000100:00100000:3.0:1787560572.914671:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787560572.914681:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815581568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787560572.914716:0:8101:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787560572.914805:0:8101:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c027b, atime: 0x6a8c027c, ctime: 0x6a8c027b, blocks: 0x1 00010000:00010000:3.0:1787560572.914817:0:8101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005331e081/0xe34191b05673fe87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.914838:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1787560572.914844:0:8101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560572.914880:0:8101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005331e081/0xe34191b05673fe87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.914901:0:8101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005331e081/0xe34191b05673fe87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.914913:0:8101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005331e081/0xe34191b05673fe87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.914937:0:8101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005331e081/0xe34191b05673fe87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.914954:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787560572.915444:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1874392815581568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 763us (947us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787560572.915450:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1787560572.915481:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787560572.915521:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d883425880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787560572.915527:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815581568:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787560572.916077:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560572.916088:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005331e081/0xe34191b05673fe87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.916102:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea200 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560572.916108:0:7629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005331e081/0xe34191b05673fe87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.916119:0:7629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005331e081/0xe34191b05673fe87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.916147:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005331e081/0xe34191b05673fe87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.916155:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005331e081/0xe34191b05673fe87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.916185:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560572.916187:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560572.916189:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560572.916341:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:11593:x1874392788333952:12345-192.168.201.56@tcp:44:lhsmtool_posix.0 Request processed in 80368us (80636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560572.916351:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 227 00000100:00100000:1.0:1787560572.916999:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815581824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787560572.917058:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560572.917114:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560572.917121:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815581696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787560572.917142:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560572.917173:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815581824 00000100:00100000:1.0:1787560572.917182:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815581824 00000100:00100000:1.0:1787560572.917241:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815581696 00000100:00100000:1.0:1787560572.917244:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815581696 00000100:00100000:1.0:1787560572.917264:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787560572.917274:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874392815581824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787560572.917500:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787560572.917505:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787560573 00002000:00010000:1.0:1787560572.917507:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787560572.917509:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787560572 -> 1787560573 00002000:00010000:1.0:1787560572.917511:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787560572.917559:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1874392815581824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 286us (500us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787560572.917566:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787560572.917580:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787560572.917587:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874392815581696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787560572.917603:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1787560572.917623:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.917645:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9571766/0xe34191b05673fc49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925c6 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.917673:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787560572.917679:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787560572.917685:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.917718:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9571766/0xe34191b05673fc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925c6 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560572.917734:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9571766/0xe34191b05673fc49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925c6 expref: 12 pid: 6685 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560572.917757:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815581952:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560572.917818:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357ca80 going to sleep for 11 seconds 00000100:00080000:1.0:1787560572.917901:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787560572.917937:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d99840e680/2, rc 0, transno 4294967321 00000100:00100000:1.0:1787560572.917946:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815581824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787560572.921677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560572.921961:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815581952:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560572.922007:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560572.922517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.923804:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788334208 00000100:00100000:3.0:1787560572.923819:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788334208 00010000:00010000:3.0:1787560572.923910:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9571766/0xe34191b05673fc49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925c6 expref: 13 pid: 6685 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.923963:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:3.0:1787560572.923974:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+13:2343:x1874392788334208:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560572.923993:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560572.924000:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9571766/0xe34191b05673fc49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925c6 expref: 13 pid: 6685 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.924015:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9571766/0xe34191b05673fc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925c6 expref: 13 pid: 6685 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.924067:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9571766/0xe34191b05673fc49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925c6 expref: 13 pid: 6685 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.924091:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560572.924096:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560572.924103:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.924115:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.924156:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560572.924209:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.924220:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.924231:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.924239:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.924241:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+12:2343:x1874392788334208:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 269us (1726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560572.924250:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 83 00010000:00010000:2.0:1787560572.924261:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560572.924279:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560572.924287:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.924295:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261200 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560572.924299:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.924308:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.924332:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.924339:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083a3727b/0xe34191b05673fe8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.924358:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560572.924361:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560572.924362:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560572.924965:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788334080 00000100:00100000:0.0:1787560572.924973:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788334080 00000100:00100000:0.0:1787560572.925063:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 68 00000100:00100000:0.0:1787560572.925073:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+12:2342:x1874392788334080:12345-192.168.201.56@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787560572.925358:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1874392815581696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7769us (8212us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787560572.925366:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1787560572.925389:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d99840d880/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787560572.925397:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815581696:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787560572.981087:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:3.0:1787560572.981113:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1787560572.981120:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:3.0:1787560572.981137:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:0.0:1787560572.983389:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788334080:12345-192.168.201.56@tcp:16:lhsmtool_posix.0 Request processed in 58301us (61710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560572.983406:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 68 00000100:00100000:2.0:1787560572.988582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.988684:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788334464 00000100:00100000:3.0:1787560572.988697:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788334464 00000100:00100000:3.0:1787560572.988787:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 228 00000100:00100000:3.0:1787560572.988800:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:11593:x1874392788334464:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787560572.988920:0:11858:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560572.988954:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92659 expref: 20 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.988983:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:3.0:1787560572.988994:0:11858:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560572.989240:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.989334:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.989349:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560572.990137:0:11858:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e78fbab reply state 000000005f8b2879 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.990151:0:11858:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560572.990302:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:11593:x1874392788334464:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 1501us (1734us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787560572.990311:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 228 00000100:00100000:1.0:1787560572.994409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.994503:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788334592 00000100:00100000:3.0:1787560572.994518:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788334592 00000100:00100000:3.0:1787560572.994592:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:3.0:1787560572.994607:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2342:x1874392788334592:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787560572.995228:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787560572.995234:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787560573 -> 1787560572 00002000:00010000:3.0:1787560572.995237:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787560572 00002000:00010000:3.0:1787560572.995239:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787560573 -> 1787560572 00002000:00010000:3.0:1787560572.995241:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787560572.995325:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2342:x1874392788334592:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 Request processed in 719us (930us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787560572.995334:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 69 00010000:00010000:2.0:1787560572.995957:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.995991:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.995999:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.996004:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560572.996021:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.996028:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.996048:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:2.0:1787560572.996051:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560572.996057:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560572.996063:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea600/0xe34191b05673fe95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560572.999075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560572.999275:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788334848 00000100:00100000:3.0:1787560572.999308:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788334848 00000100:00100000:3.0:1787560572.999381:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 229 00000100:00100000:3.0:1787560572.999393:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:11593:x1874392788334848:12345-192.168.201.56@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787560572.999487:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.999508:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9264b expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.999519:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.999563:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9264b expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560572.999579:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9264b expref: 20 pid: 5839 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560572.999597:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883427100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815582080:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560572.999728:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987f520c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560573.002686:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883427100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6706:1874392815582080:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560573.002727:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560573.004149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560573.004247:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788334976 00000100:00100000:0.0:1787560573.004259:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788334976 00010000:00010000:0.0:1787560573.004327:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9264b expref: 21 pid: 5839 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560573.004371:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:0.0:1787560573.004399:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:2342:x1874392788334976:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560573.004418:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560573.004426:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9264b expref: 21 pid: 5839 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.004441:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9264b expref: 21 pid: 5839 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.004466:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261800/0xe34191b05673fe56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9264b expref: 21 pid: 5839 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.004486:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:0.0:1787560573.004492:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.004502:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.004511:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.004549:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560573.004615:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:2342:x1874392788334976:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 218us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560573.004623:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 84 00010000:00010000:2.0:1787560573.004777:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.004785:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.004819:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.004827:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.004841:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.004893:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560573.004898:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.004907:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.004916:0:6706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:2.0:1787560573.004919:0:6706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787560573.004923:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.004930:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05673fe9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560573.004986:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:11593:x1874392788334848:12345-192.168.201.56@tcp:55:lhsmtool_posix.0 Request processed in 5596us (5927us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787560573.004996:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 229 00000100:00080000:1.0:1787560573.005173:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560573.009167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560573.009245:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788335104 00000100:00100000:2.0:1787560573.009268:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788335104 00000100:00100000:2.0:1787560573.009342:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:2.0:1787560573.009354:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2344:x1874392788335104:12345-192.168.201.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787560573.009420:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.009446:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.009475:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560573.009480:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560573.009486:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.009533:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.009550:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 8 pid: 6684 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560573.009568:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815582208:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560573.009681:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9904760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560573.012377:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6684:1874392815582208:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560573.012418:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560573.014173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560573.014482:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788335232 00000100:00100000:2.0:1787560573.014496:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788335232 00010000:00010000:2.0:1787560573.014553:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 9 pid: 6684 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560573.014603:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:2.0:1787560573.014616:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+9:2343:x1874392788335232:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560573.014658:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560573.014690:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 9 pid: 6684 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.014706:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 9 pid: 6684 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.014734:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006498c630/0xe34191b05673fe80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92667 expref: 9 pid: 6684 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.014764:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560573.014770:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787560573.014776:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.014788:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.014824:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560573.015734:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.015778:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.015813:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.015823:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.015833:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.015841:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711000 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560573.015872:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.015883:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.015904:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.015911:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e75fa2d/0xe34191b05673fea3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560573.016147:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2344:x1874392788335104:12345-192.168.201.56@tcp:1:lhsmtool_posix.0 Request processed in 6790us (6990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560573.016158:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 70 00000100:00100000:2.0:1787560573.016464:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2343:x1874392788335232:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 1836us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560573.016480:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:0.0:1787560573.019633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560573.019728:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788335488 00000100:00100000:1.0:1787560573.019739:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788335488 00000100:00100000:1.0:1787560573.019827:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 230 00000100:00100000:1.0:1787560573.019841:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:11593:x1874392788335488:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787560573.019989:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673feaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.020271:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673feaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.020290:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673feaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.020581:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.020595:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92652 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.020605:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.020652:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92652 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.020699:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92652 expref: 20 pid: 5839 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560573.020717:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815582336:192.168.201.56@tcp:104: 00000100:00100000:1.0:1787560573.020940:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d88318a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560573.024350:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815582336:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560573.024400:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560573.024454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560573.025027:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788335616 00000100:00100000:0.0:1787560573.025037:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788335616 00010000:00010000:0.0:1787560573.025192:0:7630:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92652 expref: 21 pid: 5839 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560573.025301:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:0.0:1787560573.025313:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9adaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:2343:x1874392788335616:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560573.025332:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560573.025341:0:7630:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92652 expref: 21 pid: 5839 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.025357:0:7630:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92652 expref: 21 pid: 5839 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.025383:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260000/0xe34191b05673fe64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92652 expref: 21 pid: 5839 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.025404:0:7630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:0.0:1787560573.025409:0:7630:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.025421:0:7630:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.025429:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.025462:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560573.025539:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9adaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:2343:x1874392788335616:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 227us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560573.025547:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 86 00010000:00010000:2.0:1787560573.025842:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.025898:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560573.026177:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787560573.026368:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787560573.026416:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787560573.026524:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874392815582464:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787560573.026591:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560573.026629:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d990476240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560573.027071:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815582464 00000100:00100000:1.0:1787560573.027081:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815582464 00000100:00100000:1.0:1787560573.027139:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560573.027150:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874392815582464:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787560573.027247:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874392815582464:12345-0@lo:1000:mdt00_000.0 Request processed in 99us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560573.027512:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560573.027566:0:5837:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1787560573.027572:0:5837:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1787560573.027597:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d99840e680, transno 4294967321 00000004:00080000:1.0:1787560573.027609:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d99840d880, transno 4294967322 00000100:00100000:1.0:1787560573.027616:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874392815582464:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787560573.028456:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787560573.028553:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874392815582592:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787560573.028629:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560573.028661:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d88318a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560573.029626:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815582592 00000100:00100000:2.0:1787560573.029638:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815582592 00000100:00100000:2.0:1787560573.029690:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560573.029700:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1874392815582592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787560573.029978:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1874392815582592:12345-0@lo:1000:mdt00_000.0 Request processed in 279us (1348us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787560573.029986:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787560573.030997:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1874392815582592:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787560573.031190:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031223:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031233:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031240:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560573.031246:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031255:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031279:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d995c27f00) 00010000:00010000:1.0:1787560573.031282:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560573.031289:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031295:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b05673feb1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031343:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031349:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031356:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031361:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560573.031370:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031376:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031385:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:1.0:1787560573.031388:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560573.031397:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92636 expref: 23 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031411:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92636 expref: 23 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031421:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92636 expref: 23 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.031468:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92636 expref: 23 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560573.031486:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815582720:192.168.201.56@tcp:105: 00000100:00100000:1.0:1787560573.031640:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d88318a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560573.034467:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1874392815582720:192.168.201.56@tcp:105: 00010000:00010000:3.0:1787560573.034516:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034551:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b05673fdf4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034590:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673feb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034607:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673feb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034621:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673feb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034633:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673feb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034640:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673feb8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034646:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673feb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034653:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebe00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560573.034657:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673feb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034664:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673feb8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034677:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:3.0:1787560573.034681:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560573.034684:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673feb8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034700:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebe00/0xe34191b05673feb8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034717:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673feaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034724:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673feaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034729:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673feaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034734:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560573.034738:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673feaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034743:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673feaa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034763:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:3.0:1787560573.034766:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787560573.034769:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673feaa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.034775:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261400/0xe34191b05673feaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560573.035385:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:11593:x1874392788335488:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 15541us (15759us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1787560573.035396:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 230 00000020:00080000:3.0:1787560573.035412:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787560573.037386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560573.037604:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788335744 00000100:00100000:0.0:1787560573.037632:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788335744 00000100:00100000:0.0:1787560573.037699:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:0.0:1787560573.037710:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:11591:x1874392788335744:12345-192.168.201.56@tcp:49:lfs.0 00000100:00100000:0.0:1787560573.037910:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:11591:x1874392788335744:12345-192.168.201.56@tcp:49:lfs.0 Request processed in 200us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560573.037918:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:0.0:1787560573.041076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560573.041834:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788336000 00000100:00100000:3.0:1787560573.041870:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788336000 00000100:00100000:3.0:1787560573.041948:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 231 00000100:00100000:3.0:1787560573.041961:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:11591:x1874392788336000:12345-192.168.201.56@tcp:58:lfs.0 00000040:00080000:3.0:1787560573.042618:0:11858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787560573.042741:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:11591:x1874392788336000:12345-192.168.201.56@tcp:58:lfs.0 Request processed in 779us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560573.042763:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 231 00000040:00080000:2.0:1787560573.045576:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787560573.045587:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787560573.045641:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787560573.045648:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787560573.045827:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815582848:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787560573.045972:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d990476480 going to sleep for 11 seconds 00000100:00100000:1.0:1787560573.046422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560573.049808:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788336256 00000100:00100000:2.0:1787560573.049830:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788336256 00000100:00100000:2.0:1787560573.049957:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:2.0:1787560573.049968:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae745850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+24:11593:x1874392788336256:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787560573.053390:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787560573.053513:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787560573.053571:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.053592:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.053606:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.053614:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.053621:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.053628:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560573.053662:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560573.060482:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560573.060502:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.060517:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711c00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560573.060522:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.060553:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.060577:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff93d987fff700) 00010000:00010000:1.0:1787560573.060581:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787560573.060587:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.060594:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711c00/0xe34191b05673febf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.060625:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560573.060627:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560573.060629:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560573.060916:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae745850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:11593:x1874392788336256:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 10938us (14485us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787560573.060929:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 62 00000020:00080000:2.0:1787560573.060939:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787560573.063732:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11676:1874392815582848:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787560573.073669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560573.073788:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788336384 00000100:00100000:2.0:1787560573.073803:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788336384 00000100:00100000:2.0:1787560573.073921:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 232 00000100:00100000:2.0:1787560573.073933:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:11597:x1874392788336384:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787560573.073991:0:6706:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787560573.074143:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+25:11597:x1874392788336384:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 211us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560573.074150:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 232 00000100:00100000:1.0:1787560573.080478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560573.080534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560573.080677:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788336512 00000100:00100000:0.0:1787560573.080691:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788336512 00000100:00100000:0.0:1787560573.080765:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788336768 00000100:00100000:0.0:1787560573.080768:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788336768 00000100:00100000:0.0:1787560573.080801:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 233 00000100:00100000:0.0:1787560573.080812:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+26:11595:x1874392788336512:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560573.080844:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560573.080901:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fec6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9266e expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.080986:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fecd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.081016:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.081030:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.081049:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673fed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.081077:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673fed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.081084:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673fed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.081470:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.081482:0:11858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9262f expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.081492:0:11858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.081536:0:11858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9262f expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.081553:0:11858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9262f expref: 27 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560573.081570:0:11858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bfc7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815582976:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560573.081677:0:11858:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bad68840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560573.081972:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 234 00000100:00100000:1.0:1787560573.081993:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+27:11597:x1874392788336768:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787560573.082005:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560573.082018:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fee2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92675 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.082108:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.082119:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.082130:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560573.082155:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787560573.082325:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260e00/0xe34191b05673fee2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92675 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.082345:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92675 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.082356:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:1.0:1787560573.082359:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787560573.082363:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.082370:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560573.082376:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261a00, rc 0) 00000100:00100000:1.0:1787560573.082433:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:11597:x1874392788336768:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 451us (1898us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787560573.082442:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 234 00000100:00100000:3.0:1787560573.087061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560573.087205:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788337024 00000100:00100000:1.0:1787560573.087218:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788337024 00000100:00100000:1.0:1787560573.087313:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:1.0:1787560573.087328:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:9221:x1874392788337024:12345-192.168.201.56@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787560573.087652:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:9221:x1874392788337024:12345-192.168.201.56@tcp:35:ldlm_bl.0 Request processed in 327us (616us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787560573.087661:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 63 00000100:00100000:0.0:1787560573.088530:0:11858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bfc7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11858:1874392815582976:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560573.088566:0:11858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560573.092622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560573.094447:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788337152 00000100:00100000:3.0:1787560573.094467:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788337152 00010000:00010000:3.0:1787560573.094530:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9262f expref: 30 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560573.094589:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00100000:3.0:1787560573.094602:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:2345:x1874392788337152:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560573.094622:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560573.094632:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9262f expref: 30 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.094661:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9262f expref: 30 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.094689:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fde6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9262f expref: 30 pid: 5837 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.094736:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:3.0:1787560573.094742:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.094765:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.094775:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560573.094809:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560573.094954:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:2345:x1874392788337152:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 354us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560573.094963:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 87 00010000:00010000:0.0:1787560573.095279:0:11858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095297:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560573.095357:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787560573.095362:0:11858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560573.095390:0:11858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095404:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095415:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095423:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fecd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095431:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095437:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560573.095442:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095451:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fecd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095462:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560573.095465:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560573.095469:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fecd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095487:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101400/0xe34191b05673fecd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095502:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673fed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095508:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673fed4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095514:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673fed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095519:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560573.095523:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673fed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095528:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673fed4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095536:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff93d9b104dd00) 00010000:00010000:0.0:1787560573.095539:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560573.095543:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673fed4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095548:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101c00/0xe34191b05673fed4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095592:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100a00/0xe34191b05673fec6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9266e expref: 29 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095621:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9266e expref: 28 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.095628:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:0.0:1787560573.095631:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560573.095633:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100c00, rc 0) 00000100:00100000:0.0:1787560573.095683:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+28:11595:x1874392788336512:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 14872us (15220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560573.095692:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 233 00000100:00100000:1.0:1787560573.103815:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560573.103955:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788337408 00000100:00100000:0.0:1787560573.103968:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788337408 00000100:00100000:0.0:1787560573.104062:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 235 00000100:00100000:0.0:1787560573.104077:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+28:11597:x1874392788337408:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787560573.104192:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fef7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.104213:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.104227:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.104591:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.104601:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fef7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.104632:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.104639:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560573.104645:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.104654:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fef7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.104670:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:0.0:1787560573.104673:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787560573.104678:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fef7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560573.104685:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101600/0xe34191b05673fef7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560573.104923:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:11597:x1874392788337408:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 848us (1120us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787560573.104932:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 235 00000040:00080000:2.0:1787560573.105313:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787560573.105320:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787560573.105826:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787560573.105837:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787560573.109492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560573.109793:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788337664 00000100:00100000:1.0:1787560573.109808:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788337664 00000100:00100000:1.0:1787560573.109910:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:1.0:1787560573.109924:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+29:11597:x1874392788337664:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787560573.110282:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:11597:x1874392788337664:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 360us (805us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787560573.110291:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 64 00000100:00100000:3.0:1787560573.139649:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815583104:0@lo:400:kworker.0 00000100:00100000:3.0:1787560573.139763:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560573.139834:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560573.139840:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815583232:0@lo:400:kworker.0 00000100:00100000:3.0:1787560573.139898:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560573.139932:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815583360:0@lo:400:kworker.0 00000100:00100000:3.0:1787560573.139961:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560573.139982:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560573.139987:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815583488:0@lo:400:kworker.0 00000100:00100000:3.0:1787560573.140023:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560573.140073:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815583232 00000100:00100000:3.0:1787560573.140099:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815583232 00000100:00100000:3.0:1787560573.140154:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815583360 00000100:00100000:3.0:1787560573.140158:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815583360 00000100:00080000:3.0:1787560573.140182:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560573.140194:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815583488 00000100:00100000:3.0:1787560573.140197:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815583488 00000100:00100000:3.0:1787560573.140228:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787560573.140239:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815583232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560573.140311:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815583232:12345-0@lo:400:kworker.0 Request processed in 73us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560573.140319:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787560573.140338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787560573.140345:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815583488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560573.140375:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815583488:12345-0@lo:400:kworker.0 Request processed in 32us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560573.140381:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1787560573.140395:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560573.140424:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815583488:0@lo:400:kworker.0 00000100:00100000:3.0:1787560573.140453:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815583232:0@lo:400:kworker.0 00000100:00100000:3.0:1787560573.140484:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787560573.140491:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815583360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560573.140525:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815583360:12345-0@lo:400:kworker.0 Request processed in 35us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560573.140532:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787560573.140556:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815583360:0@lo:400:kworker.0 00000100:00100000:2.0:1787560573.142181:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815583104 00000100:00100000:2.0:1787560573.142198:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815583104 00000100:00100000:2.0:1787560573.142278:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787560573.142290:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815583104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560573.142380:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989550450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3313:x1874392815583104:12345-0@lo:400:kworker.0 Request processed in 92us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560573.142388:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787560573.142701:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815583104:0@lo:400:kworker.0 00000100:00100000:3.0:1787560573.652669:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560573.652703:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815583616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560573.652815:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560573.653199:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815583616 00000100:00100000:1.0:1787560573.653211:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815583616 00000100:00100000:1.0:1787560573.653289:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787560573.653303:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874392815583616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787560573.653354:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560573.653426:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874392815583616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560573.653435:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787560573.653547:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815583616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560573.712506:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560574.153659:0:12508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787560574.153670:0:12508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787560574.153743:0:12508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787560574.153750:0:12508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787560574.455313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560574.455478:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788337920 00000100:00100000:1.0:1787560574.455494:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788337920 00000100:00100000:1.0:1787560574.455587:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 236 00000100:00100000:1.0:1787560574.455603:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+30:11619:x1874392788337920:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560574.455641:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560574.455672:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fefe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9267c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560574.455822:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673ff05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560574.455879:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673ff05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560574.455897:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673ff05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560574.455913:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787560574.456118:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260400/0xe34191b05673fefe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9267c expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560574.456142:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673ff05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9267c expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560574.456154:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:1.0:1787560574.456157:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787560574.456163:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261200, rc 0) 00000100:00100000:1.0:1787560574.456262:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:11619:x1874392788337920:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 664us (966us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787560574.456270:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 236 00000100:00100000:0.0:1787560574.491482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560574.491534:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788338048 00000100:00100000:0.0:1787560574.491547:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788338048 00000100:00100000:0.0:1787560574.491620:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 237 00000100:00100000:0.0:1787560574.491634:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:11619:x1874392788338048:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:0.0:1787560574.492376:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673ff13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560574.492406:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673ff13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560574.492420:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673ff13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560574.492453:0:11858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673ff13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560574.492460:0:11858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673ff13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560574.492467:0:11858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673ff13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560574.492473:0:11858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560574.492478:0:11858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673ff13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560574.492485:0:11858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673ff13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560574.492498:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:0.0:1787560574.492501:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560574.492506:0:11858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673ff13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560574.492512:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100200/0xe34191b05673ff13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560574.492646:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:11619:x1874392788338048:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 1013us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560574.492661:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 237 00000100:00100000:0.0:1787560574.626234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560574.627458:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788338176 00000100:00100000:3.0:1787560574.627476:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788338176 00000100:00100000:3.0:1787560574.627585:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 71 00000100:00100000:3.0:1787560574.627599:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2344:x1874392788338176:12345-192.168.201.56@tcp:101:cat.0 00010000:00010000:3.0:1787560574.627633:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560574.627662:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b05673ff1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92683 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560574.627698:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c027c, atime: 0x6a8c027c, ctime: 0x6a8c027c, blocks: 0xb 00010000:00010000:3.0:1787560574.627732:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=403s v=(0 0) 00010000:00010000:3.0:1787560574.627737:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560574.627750:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b05673ff1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92683 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560574.627773:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b05673ff1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92683 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560574.627791:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ebe00, rc 0) 00000100:00100000:3.0:1787560574.627920:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2344:x1874392788338176:12345-192.168.201.56@tcp:101:cat.0 Request processed in 325us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560574.627928:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 71 00000100:00080000:0.0:1787560574.629503:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560574.631228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560574.631376:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788338304 00000100:00100000:3.0:1787560574.631389:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788338304 00002000:00100000:3.0:1787560574.631462:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff93d99840c000 x1874392788338304/t0(0) o3->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:690/0 lens 488/0 e 0 to 0 dl 1787560585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787560574.631476:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d99840c000 with x1874392788338304 ext(0->4095) 00002000:00010000:3.0:1787560574.631482:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d99840c000 00000100:00100000:3.0:1787560574.631520:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:3.0:1787560574.631532:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2345:x1874392788338304:12345-192.168.201.56@tcp:3:cat.0 00000100:00100000:3.0:1787560574.631820:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2345:x1874392788338304:12345-192.168.201.56@tcp:3:cat.0 Request processed in 289us (604us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787560574.631829:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00002000:00100000:3.0:1787560574.631836:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff93d99840c000 x1874392788338304/t0(0) o3->3e6b7760-d76b-45e8-8d98-861d14ecc789@192.168.201.56@tcp:690/0 lens 488/4536 e 0 to 0 dl 1787560585 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787560574.631844:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d99840c000 with x1874392788338304 ext(0->4095) 00002000:00010000:3.0:1787560574.631888:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff93d99840c000 00010000:00010000:3.0:1787560574.738341:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560575.769178:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787560575.823234:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1787560575.823262:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1787560575.823275:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1787560575.924638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560575.924686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560575.924737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560575.924780:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788338816 00000100:00100000:3.0:1787560575.924795:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788338816 00000100:00100000:3.0:1787560575.924912:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:3.0:1787560575.924925:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788338816:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560575.925062:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2342:x1874392788338816:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 139us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560575.925070:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00080000:3.0:1787560575.925100:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560575.925224:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788338560 00000100:00100000:1.0:1787560575.925229:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788338560 00000100:00100000:1.0:1787560575.925270:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 160 00000100:00100000:1.0:1787560575.925285:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:2342:x1874392788338560:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560575.925321:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+32:2342:x1874392788338560:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 45us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560575.925335:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 160 00000100:00100000:0.0:1787560575.925518:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788338432 00000100:00100000:0.0:1787560575.925523:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788338432 00000100:00100000:0.0:1787560575.925564:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 298 00000100:00100000:0.0:1787560575.925572:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2343:x1874392788338432:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560575.925599:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2343:x1874392788338432:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 29us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560575.925605:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 298 00000100:00080000:3.0:1787560575.925748:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560575.936410:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560575.936473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560575.943443:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788338944 00000100:00100000:2.0:1787560575.943465:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788338944 00000100:00100000:2.0:1787560575.943566:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 161 00000100:00100000:2.0:1787560575.943578:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788338944:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560575.943721:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:2343:x1874392788338944:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 144us (7245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560575.943730:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 161 00000100:00100000:2.0:1787560575.943778:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788338688 00000100:00100000:2.0:1787560575.943783:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788338688 00000100:00100000:2.0:1787560575.943813:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00100000:2.0:1787560575.943819:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788338688:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560575.943871:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+8:2343:x1874392788338688:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 52us (7479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560575.943878:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00080000:0.0:1787560575.944588:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560576.211745:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560576.211776:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815583744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560576.211895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560576.212156:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815583744 00000100:00100000:1.0:1787560576.212167:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815583744 00000100:00100000:1.0:1787560576.212240:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787560576.212260:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815583744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560576.212310:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560576.212364:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815583744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560576.212372:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1787560576.212395:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560576.212433:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815583744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787560576.783264:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560577.823326:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560578.262483:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787560578.262491:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787560578.262524:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787560578.262531:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787560578.266395:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815584128:0@lo:400:kworker.0 00000100:00100000:1.0:1787560578.266474:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560578.266532:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560578.266538:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815584256:0@lo:400:kworker.0 00000100:00100000:1.0:1787560578.266566:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560578.266600:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815584256 00000100:00100000:1.0:1787560578.266608:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815584256 00000100:00100000:1.0:1787560578.266682:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787560578.266692:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815584256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560578.266705:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815584128 00000100:00100000:0.0:1787560578.266709:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815584128 00000100:00100000:0.0:1787560578.266738:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787560578.266743:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815584256:12345-0@lo:400:kworker.0 Request processed in 54us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560578.266745:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815584128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560578.266759:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787560578.266775:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815584128:12345-0@lo:400:kworker.0 Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00080000:1.0:1787560578.266781:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560578.266781:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1787560578.266785:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560578.266829:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815584256:0@lo:400:kworker.0 00000100:00100000:1.0:1787560578.266840:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815584128:0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.267419:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bfc7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815583872:0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.267467:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560578.267505:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815584384:0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.267534:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560578.267561:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787560578.267580:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815584000:0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.267603:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560578.267623:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815584512:0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.267669:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560578.267866:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815583872 00000100:00100000:3.0:1787560578.267873:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815583872 00000100:00100000:3.0:1787560578.267909:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787560578.267929:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815583872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.267985:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815583872:12345-0@lo:400:kworker.0 Request processed in 57us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560578.267992:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787560578.268024:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815584384 00000100:00100000:3.0:1787560578.268027:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815584384 00000100:00100000:3.0:1787560578.268058:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815584000 00000100:00100000:3.0:1787560578.268061:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815584000 00000100:00100000:3.0:1787560578.268077:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787560578.268089:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815584384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.268119:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815584384:12345-0@lo:400:kworker.0 Request processed in 31us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560578.268126:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787560578.268139:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787560578.268145:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815584000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.268172:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815584000:12345-0@lo:400:kworker.0 Request processed in 28us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560578.268178:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787560578.268195:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815584512 00000100:00100000:3.0:1787560578.268199:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815584512 00000100:00100000:3.0:1787560578.268223:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787560578.268228:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d998b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815584512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.268256:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d998b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815584512:12345-0@lo:400:kworker.0 Request processed in 28us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560578.268262:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787560578.268297:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815584000:0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.268307:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787560578.268311:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787560578.268331:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93d883425880, transno 4294967310 00000100:00100000:3.0:1787560578.268340:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815584512:0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.268349:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bfc7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815583872:0@lo:400:kworker.0 00000100:00100000:3.0:1787560578.268358:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815584384:0@lo:400:kworker.0 00000100:00080000:3.0:1787560578.268385:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560578.268394:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1787560578.359066:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1787560578.359084:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1787560578.371116:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:1.0:1787560578.371131:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787560578.371154:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff93d88318acc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787560578.371160:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d984354c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff93d88318a480 00000020:00080000:1.0:1787560578.371163:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93d984354700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93d9babbd800 00000020:00080000:1.0:1787560578.371201:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787560578.371696:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787560578.372039:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1787560578.767795:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bfc7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815584640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560578.767894:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560578.768115:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815584640 00000100:00100000:2.0:1787560578.768124:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815584640 00000100:00100000:2.0:1787560578.768169:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787560578.768177:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98735a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815584640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560578.768220:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560578.768270:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98735a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815584640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560578.768277:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787560578.768575:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bfc7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815584640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787560578.833374:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560579.861791:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560580.518703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560580.519278:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788339072 00000100:00100000:1.0:1787560580.519288:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788339072 00000100:00100000:1.0:1787560580.519364:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 238 00000100:00100000:1.0:1787560580.519379:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bfc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:11280:x1874392788339072:12345-192.168.201.56@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787560580.519485:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bfc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:11280:x1874392788339072:12345-192.168.201.56@tcp:60:lhsmtool_posix.0 Request processed in 111us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560580.519492:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 238 00000100:00080000:3.0:1787560580.519799:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560580.522604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560580.522726:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788339328 00000100:00100000:2.0:1787560580.522736:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788339328 00000100:00100000:2.0:1787560580.523092:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:2.0:1787560580.523103:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:11280:x1874392788339328:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787560580.524213:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:11280:x1874392788339328:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 1105us (1610us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787560580.524225:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 65 00000100:00100000:0.0:1787560580.648659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560580.649106:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788339456 00000100:00100000:3.0:1787560580.649116:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788339456 00000100:00100000:3.0:1787560580.649209:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 239 00000100:00100000:3.0:1787560580.649220:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb11441b-9d90-4ed1-83a2-9b2acf931bae+5:12071:x1874392788339456:12345-192.168.201.56@tcp:101:lsof.0 00010000:00010000:3.0:1787560580.649240:0:11858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560580.649261:0:11858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673ff21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9268a expref: -99 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560580.649341:0:11858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673ff28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787560580.649350:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787560580.649356:0:11858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673ff28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560580.649370:0:11858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673ff28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560580.650077:0:11858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787560580.650082:0:11858:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560580.650205:0:11858:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673ff28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560580.650237:0:11858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eac00/0xe34191b05673ff21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9268a expref: 7 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560580.650268:0:11858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673ff28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9268a expref: 6 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560580.650277:0:11858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:3.0:1787560580.650281:0:11858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560580.650285:0:11858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb200, rc 0) 00000100:00100000:3.0:1787560580.650477:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:12071:x1874392788339456:12345-192.168.201.56@tcp:101:lsof.0 Request processed in 1258us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560580.650486:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 239 00010000:00010000:0.0:1787560580.879144:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560581.044018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560581.044098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560581.044251:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788339584 00000100:00100000:2.0:1787560581.044267:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788339584 00000100:00100000:2.0:1787560581.044441:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 300 00000100:00100000:2.0:1787560581.044453:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788339584:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560581.044539:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788339584:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 88us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560581.044547:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 300 00000100:00100000:1.0:1787560581.044769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560581.044798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560581.044877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560581.045406:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788340096 00000100:00100000:1.0:1787560581.045418:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788340096 00000100:00100000:1.0:1787560581.045479:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788339712 00000100:00100000:1.0:1787560581.045482:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788339712 00000100:00100000:1.0:1787560581.045507:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 165 00000100:00100000:1.0:1787560581.045517:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2344:x1874392788340096:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560581.045597:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2344:x1874392788340096:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 81us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560581.045605:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 165 00000100:00100000:1.0:1787560581.045634:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 166 00000100:00100000:1.0:1787560581.045642:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:2344:x1874392788339712:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560581.045679:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:2344:x1874392788339712:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 39us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560581.045686:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 166 00000100:00100000:1.0:1787560581.045716:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788339840 00000100:00100000:1.0:1787560581.045720:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788339840 00000100:00100000:1.0:1787560581.045757:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788339968 00000100:00100000:1.0:1787560581.045760:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788339968 00000100:00100000:1.0:1787560581.045784:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 96 00000100:00100000:1.0:1787560581.045792:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2344:x1874392788339840:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560581.045822:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2344:x1874392788339840:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 32us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560581.045872:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 96 00000100:00100000:1.0:1787560581.045886:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00100000:1.0:1787560581.045894:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788339968:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560581.046276:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788339968:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 382us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560581.046283:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00080000:1.0:1787560581.046313:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560581.046318:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560581.327465:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9900a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815584768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560581.327569:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560581.328235:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815584768 00000100:00100000:1.0:1787560581.328247:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815584768 00000100:00100000:1.0:1787560581.328344:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787560581.328356:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815584768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560581.328410:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560581.328532:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815584768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560581.328540:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787560581.328612:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560581.331250:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787560581.331265:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787560581.331317:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9900a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815584768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787560581.905331:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560582.927081:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560583.375369:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815584896:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.376083:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b393a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815585280:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.376128:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560583.376366:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560583.376374:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815585152:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.376407:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560583.376442:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815585024:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.376466:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560583.376485:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b393ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815585536:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.376504:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560583.376535:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815585152 00000100:00100000:2.0:1787560583.376544:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815585152 00000100:00100000:3.0:1787560583.376576:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560583.376618:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b393a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815585408:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.376631:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815585024 00000100:00100000:2.0:1787560583.376635:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815585024 00000100:00100000:3.0:1787560583.376653:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560583.376967:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815585408 00000100:00100000:2.0:1787560583.376972:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815585408 00000100:00100000:2.0:1787560583.376999:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787560583.377008:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815585152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.378089:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815585152:12345-0@lo:400:kworker.0 Request processed in 1074us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560583.378112:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787560583.378141:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787560583.378150:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815585024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.378318:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815585024:12345-0@lo:400:kworker.0 Request processed in 169us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560583.378324:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787560583.378339:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787560583.378347:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815585408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.378384:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815585408:12345-0@lo:400:kworker.0 Request processed in 39us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560583.378390:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1787560583.378409:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560583.378455:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815585024:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.378491:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815585152:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.378532:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815585280 00000100:00100000:2.0:1787560583.378536:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815585280 00000100:00100000:2.0:1787560583.378586:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815585536 00000100:00100000:2.0:1787560583.378590:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815585536 00000100:00100000:2.0:1787560583.378612:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787560583.378680:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815585280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.378791:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815585280:12345-0@lo:400:kworker.0 Request processed in 113us (2662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560583.378798:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787560583.378810:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787560583.378816:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815585536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.378884:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815585536:12345-0@lo:400:kworker.0 Request processed in 68us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560583.378890:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1787560583.379094:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787560583.379097:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560583.379116:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b393ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815585536:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.379144:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b393a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815585280:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.379511:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815584896 00000100:00100000:2.0:1787560583.379517:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815584896 00000100:00100000:2.0:1787560583.379553:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787560583.379559:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815584896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.379612:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815584896:12345-0@lo:400:kworker.0 Request processed in 54us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560583.379633:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787560583.379683:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815584896:0@lo:400:kworker.0 00000100:00100000:2.0:1787560583.379697:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b393a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815585408:0@lo:400:kworker.0 00000001:00080000:2.0:1787560583.457335:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787560583.457357:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787560583.458287:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787560583.458305:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1787560583.895926:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815585664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560583.896026:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560583.896343:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815585664 00000100:00100000:3.0:1787560583.896354:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815585664 00000100:00100000:3.0:1787560583.896412:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787560583.896425:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815585664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560583.896472:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560583.896537:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815585664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560583.896569:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787560583.896761:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815585664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560583.968349:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787560584.166786:0:12714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:36:22 (1787560582) 00010000:00010000:0.0:1787560584.975073:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560586.007677:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560586.164221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560586.164261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560586.164307:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560586.164327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560586.164352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560586.164456:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788340352 00000100:00100000:2.0:1787560586.164471:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788340352 00000100:00100000:2.0:1787560586.164561:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788340736 00000100:00100000:2.0:1787560586.164581:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788340736 00000100:00100000:2.0:1787560586.164628:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 170 00000100:00100000:2.0:1787560586.164640:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:2344:x1874392788340352:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560586.164736:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:2344:x1874392788340352:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 98us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.164745:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 170 00000100:00100000:2.0:1787560586.164764:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 171 00000100:00100000:2.0:1787560586.164771:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2344:x1874392788340736:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560586.164812:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2344:x1874392788340736:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 41us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.164818:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 171 00000100:00100000:2.0:1787560586.164840:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788340224 00000100:00100000:2.0:1787560586.164844:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788340224 00000100:00100000:2.0:1787560586.164907:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 302 00000100:00100000:2.0:1787560586.164914:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788340224:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560586.164942:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788340224:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 29us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.164948:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 302 00000100:00100000:2.0:1787560586.164994:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788340608 00000100:00100000:2.0:1787560586.164999:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788340608 00000100:00100000:2.0:1787560586.165029:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788340480 00000100:00100000:2.0:1787560586.165032:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788340480 00000100:00100000:2.0:1787560586.165053:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00100000:2.0:1787560586.165059:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788340608:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560586.165086:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2344:x1874392788340608:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 27us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.165101:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00100000:2.0:1787560586.165114:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 101 00000100:00100000:2.0:1787560586.165120:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9900a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2344:x1874392788340480:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560586.165148:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9900a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2344:x1874392788340480:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 28us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560586.165154:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 101 00000100:00080000:1.0:1787560586.166231:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560586.166238:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560586.166255:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560586.456710:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560586.456742:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815585792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560586.456888:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560586.457328:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815585792 00000100:00100000:1.0:1787560586.457340:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815585792 00000100:00100000:1.0:1787560586.457437:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787560586.457450:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815585792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560586.457499:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560586.457575:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815585792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560586.457583:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787560586.457646:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815585792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787560586.459616:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787560587.023093:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560588.047082:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560588.495176:0:11676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787560588.495186:0:11676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560588.495670:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787560588.495677:0:11676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787560588.498133:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815586048:0@lo:400:kworker.0 00000100:00100000:2.0:1787560588.498206:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560588.498262:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815586560:0@lo:400:kworker.0 00000100:00100000:2.0:1787560588.498286:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560588.498316:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787560588.498322:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815585920:0@lo:400:kworker.0 00000100:00100000:2.0:1787560588.498352:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560588.498375:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815586432:0@lo:400:kworker.0 00000100:00100000:2.0:1787560588.498396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560588.498421:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815586176:0@lo:400:kworker.0 00000100:00100000:2.0:1787560588.498444:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560588.498461:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560588.498466:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815586304:0@lo:400:kworker.0 00000100:00100000:2.0:1787560588.498498:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560588.498534:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815586048 00000100:00100000:2.0:1787560588.498541:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815586048 00000100:00100000:0.0:1787560588.498864:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815586432 00000100:00100000:0.0:1787560588.498869:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815586432 00000100:00100000:0.0:1787560588.498915:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815586176 00000100:00100000:0.0:1787560588.498918:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815586176 00000100:00100000:0.0:1787560588.498941:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787560588.498970:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815586432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560588.499015:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815585920 00000100:00100000:0.0:1787560588.499019:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815585920 00000100:00100000:0.0:1787560588.499045:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787560588.499052:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815585920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560588.499928:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3312:x1874392815585920:12345-0@lo:400:kworker.0 Request processed in 873us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560588.499938:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787560588.499980:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815586560 00000100:00100000:0.0:1787560588.499985:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815586560 00000100:00100000:3.0:1787560588.507288:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787560588.507307:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815586176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560588.507399:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815586176:12345-0@lo:400:kworker.0 Request processed in 99us (8954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560588.507408:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787560588.520311:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815586304 00000100:00100000:0.0:1787560588.520326:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815586304 00000100:00100000:1.0:1787560588.520991:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874392815586432:12345-0@lo:400:kworker.0 Request processed in 22038us (22589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560588.521003:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1787560588.521034:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560588.521038:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787560588.521041:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560588.521095:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815585920:0@lo:400:kworker.0 00000100:00100000:1.0:1787560588.522395:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815586432:0@lo:400:kworker.0 00000100:00100000:3.0:1787560588.522909:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787560588.523568:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b393a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815586560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560588.523641:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b393a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815586560:12345-0@lo:400:kworker.0 Request processed in 722us (25353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560588.523648:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787560588.523686:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815586560:0@lo:400:kworker.0 00000100:00100000:3.0:1787560588.523706:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787560588.523713:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815586304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560588.523752:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815586304:12345-0@lo:400:kworker.0 Request processed in 40us (25253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560588.523758:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787560588.523802:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815586304:0@lo:400:kworker.0 00000100:00100000:3.0:1787560588.523815:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815586176:0@lo:400:kworker.0 00000100:00100000:3.0:1787560588.523888:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787560588.523897:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815586048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560588.523934:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815586048:12345-0@lo:400:kworker.0 Request processed in 39us (25729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560588.523949:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787560588.523976:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815586048:0@lo:400:kworker.0 00000100:00100000:2.0:1787560589.012292:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bf923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815586688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560589.012362:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560589.012583:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815586688 00000100:00100000:3.0:1787560589.012592:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815586688 00000100:00100000:3.0:1787560589.012646:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787560589.012656:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815586688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560589.012691:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560589.012736:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815586688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560589.012743:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787560589.012943:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bf923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815586688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787560589.073696:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560590.066937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560590.067022:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788340992 00000100:00100000:3.0:1787560590.067033:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788340992 00000100:00100000:3.0:1787560590.067112:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00100000:3.0:1787560590.067124:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+19:12292:x1874392788340992:12345-192.168.201.56@tcp:35:umount.0 00000100:00100000:3.0:1787560590.067724:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:12292:x1874392788340992:12345-192.168.201.56@tcp:35:umount.0 Request processed in 602us (795us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787560590.067733:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 66 00000100:00080000:1.0:1787560590.068317:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560590.072392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560590.073343:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788341248 00000100:00100000:3.0:1787560590.073355:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788341248 00000100:00100000:3.0:1787560590.073415:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 67 00000100:00100000:3.0:1787560590.073427:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+20:12292:x1874392788341248:12345-192.168.201.56@tcp:35:umount.0 00000100:00100000:3.0:1787560590.073766:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:12292:x1874392788341248:12345-192.168.201.56@tcp:35:umount.0 Request processed in 340us (1381us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787560590.073774:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 67 00000100:00100000:3.0:1787560590.080572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560590.080868:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788341504 00000100:00100000:2.0:1787560590.080878:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788341504 00000100:00100000:2.0:1787560590.080988:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 68 00000100:00100000:2.0:1787560590.081000:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ae744050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+21:12292:x1874392788341504:12345-192.168.201.56@tcp:35:umount.0 00000100:00100000:2.0:1787560590.083921:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ae744050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:12292:x1874392788341504:12345-192.168.201.56@tcp:35:umount.0 Request processed in 2912us (3347us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787560590.083934:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 68 00010000:00010000:0.0:1787560590.096081:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560590.101579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560590.105004:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788341760 00000100:00100000:0.0:1787560590.105020:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788341760 00000100:00100000:0.0:1787560590.105117:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:0.0:1787560590.105130:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+22:12292:x1874392788341760:12345-192.168.201.56@tcp:35:umount.0 00000100:00100000:0.0:1787560590.105538:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:12292:x1874392788341760:12345-192.168.201.56@tcp:35:umount.0 Request processed in 410us (3968us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787560590.105546:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 69 00000100:00100000:1.0:1787560590.109612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560590.109652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560590.109677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560590.109703:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788341888 00000100:00100000:1.0:1787560590.109711:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788341888 00000100:00100000:1.0:1787560590.109759:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788342144 00000100:00100000:1.0:1787560590.109762:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788342144 00000100:00100000:1.0:1787560590.109772:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788342016 00000100:00100000:1.0:1787560590.109774:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788342016 00000100:00100000:1.0:1787560590.109787:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:1.0:1787560590.109795:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+15:2344:x1874392788341888:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560590.109809:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560590.109826:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21db000/0xe34191b05673ef3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92215 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560590.109842:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560590.109913:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+14:2344:x1874392788341888:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 118us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560590.109920:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:1.0:1787560590.109935:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:1.0:1787560590.109941:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+13:2344:x1874392788342144:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560590.109948:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560590.109956:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c5200/0xe34191b05673f1b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922e0 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560590.109966:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560590.109978:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+12:2344:x1874392788342144:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 38us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560590.109999:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:1.0:1787560590.110009:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:1.0:1787560590.110015:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+11:2344:x1874392788342016:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560590.110023:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560590.110030:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4462000/0xe34191b05673ef06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf921dd expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560590.110038:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560590.110051:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2344:x1874392788342016:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 37us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560590.110057:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:3.0:1787560590.116750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560590.117380:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788342272 00000100:00100000:2.0:1787560590.117391:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788342272 00000100:00100000:2.0:1787560590.117470:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00100000:2.0:1787560590.117482:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2341:x1874392788342272:12345-192.168.201.56@tcp:9:umount.0 00000020:00000080:2.0:1787560590.117514:0:6684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673f278 00000100:00080000:2.0:1787560590.117523:0:6684:0:(import.c:65:import_set_state_nolock()) ffff93d9b4025800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560590.117569:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787560590.117825:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e6b7760-d76b-45e8-8d98-861d14ecc789+2:2341:x1874392788342272:12345-192.168.201.56@tcp:9:umount.0 Request processed in 346us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560590.117833:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 72 00000100:00080000:1.0:1787560590.117934:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787560590.118188:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560590.130216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560590.130555:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788342656 00000100:00100000:3.0:1787560590.130565:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788342656 00000100:00100000:3.0:1787560590.130638:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 73 00000100:00100000:3.0:1787560590.130649:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2341:x1874392788342656:12345-192.168.201.56@tcp:9:umount.0 00000020:00000080:3.0:1787560590.130681:0:6685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673f4e0 00000020:00010000:3.0:1787560590.130688:0:6685:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93d9b3810000: total 0 00000100:00080000:3.0:1787560590.130693:0:6685:0:(import.c:65:import_set_state_nolock()) ffff93d9b3816800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560590.130742:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787560590.131024:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e6b7760-d76b-45e8-8d98-861d14ecc789+5:2341:x1874392788342656:12345-192.168.201.56@tcp:9:umount.0 Request processed in 376us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560590.131031:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 73 00000020:00010000:0.0:1787560590.131373:0:7629:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93d9b3810000: total 0 00010000:00010000:0.0:1787560590.131406:0:7629:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d9b3810000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787560590.131473:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b1c198c/0xe34191b05673f87c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924b5 expref: 4 pid: 8101 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.131509:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b05673ff1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92683 expref: 3 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.131528:0:7629:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d9b3810000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787560590.131539:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560590.131541:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560590.131543:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787560590.131761:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560590.140934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560590.141582:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788343680 00000100:00100000:3.0:1787560590.141596:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788343680 00000100:00100000:3.0:1787560590.141679:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 240 00000100:00100000:3.0:1787560590.141692:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+23:2341:x1874392788343680:12345-192.168.201.56@tcp:39:umount.0 00000020:00000080:3.0:1787560590.141738:0:11858:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ef14 00000020:00010000:3.0:1787560590.141761:0:11858:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93d881255800: total 0 00000100:00080000:3.0:1787560590.141767:0:11858:0:(import.c:65:import_set_state_nolock()) ffff93d881251800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560590.141800:0:11858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1787560590.142240:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93d881255800: total 0 00010000:00010000:0.0:1787560590.142304:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d881255800, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1787560590.142344:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d987fb3100) 00010000:00010000:0.0:1787560590.142348:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560590.142359:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b05673f1fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922f5 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142392:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:0.0:1787560590.142395:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560590.142399:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea000/0xe34191b05673f8de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924d1 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142441:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:0.0:1787560590.142444:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787560590.142458:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261200/0xe34191b05673ff05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9267c expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142474:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:0.0:1787560590.142476:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560590.142480:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b05673f83d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924a0 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142492:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:0.0:1787560590.142494:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787560590.142497:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990101e00/0xe34191b05673f867 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924ae expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142514:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:0.0:1787560590.142517:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560590.142520:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d990100c00/0xe34191b05673fedb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9266e expref: 18 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142535:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:0.0:1787560590.142537:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787560590.142541:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d980030600/0xe34191b05673f53b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf923dc expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142554:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d987d52100) 00010000:00010000:0.0:1787560590.142556:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560590.142567:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710a00/0xe34191b05673f1de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922ee expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142589:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560590.142592:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787560590.142596:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b05673fbd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf925aa expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142608:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff93d995c27500) 00010000:00010000:0.0:1787560590.142611:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787560590.142614:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05673f24e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9230a expref: 14 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142629:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:0.0:1787560590.142631:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560590.142635:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eaa00/0xe34191b05673fdfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92636 expref: 13 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142648:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff93d987fff800) 00010000:00010000:0.0:1787560590.142651:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787560590.142655:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05673fee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92675 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142670:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff93d995c27d00) 00010000:00010000:0.0:1787560590.142673:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787560590.142676:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260600/0xe34191b05673f8fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf924d8 expref: 11 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142690:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff93d987fb3f00) 00010000:00010000:0.0:1787560590.142698:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560590.142702:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05673f75d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92468 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560590.142716:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d881255800, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1787560590.142728:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560590.142731:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560590.142732:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560590.143170:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3e6b7760-d76b-45e8-8d98-861d14ecc789+7:2341:x1874392788343680:12345-192.168.201.56@tcp:39:umount.0 Request processed in 1478us (2248us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787560590.143182:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 240 00010000:00010000:3.0:1787560591.146777:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787560591.191391:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:0.0:1787560591.191405:0:7642:0:(genops.c:885:class_export_put()) final put ffff93d9b4027000/3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:2.0:1787560591.195905:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b4027000/3e6b7760-d76b-45e8-8d98-861d14ecc789 for lustre-OST0001 00000020:00000080:2.0:1787560591.196002:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9b4025800 for lustre-OST0001 00000100:00100000:3.0:1787560591.283707:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560591.283776:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560591.284133:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788343808 00000100:00100000:2.0:1787560591.284146:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788343808 00000100:00100000:2.0:1787560591.284228:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 304 00000100:00100000:2.0:1787560591.284240:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d989552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2342:x1874392788343808:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560591.284339:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d989552450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2342:x1874392788343808:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 100us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560591.284355:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 304 00000100:00100000:0.0:1787560591.284461:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788343936 00000100:00100000:0.0:1787560591.284466:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788343936 00000100:00100000:0.0:1787560591.284526:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 175 00000100:00100000:0.0:1787560591.284534:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2342:x1874392788343936:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560591.284571:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2342:x1874392788343936:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 39us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560591.284578:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 175 00000100:00080000:2.0:1787560591.284813:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560591.568937:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560591.568971:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815586816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560591.569067:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560591.569291:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815586816 00000100:00100000:1.0:1787560591.569302:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815586816 00000100:00100000:1.0:1787560591.569383:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787560591.569402:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815586816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560591.569455:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560591.569514:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815586816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560591.569522:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787560591.569575:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815586816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560591.570348:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560592.210294:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560592.679113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560592.679312:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788344320 00000100:00100000:1.0:1787560592.679342:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788344320 00000100:00100000:1.0:1787560592.679446:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:1.0:1787560592.679460:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2344:x1874392788344320:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560592.679484:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560592.679511:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98a710c00/0xe34191b05673f1ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf922d9 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560592.679542:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560592.679615:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:194701de-fe21-4f70-a6ed-c87f3844b85e+9:2344:x1874392788344320:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 159us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560592.679623:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:3.0:1787560592.680129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560592.680162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560592.680345:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788344064 00000100:00100000:0.0:1787560592.680352:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788344064 00000100:00100000:0.0:1787560592.680395:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788344192 00000100:00100000:0.0:1787560592.680399:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788344192 00000100:00100000:0.0:1787560592.680426:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:0.0:1787560592.680434:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:194701de-fe21-4f70-a6ed-c87f3844b85e+10:2342:x1874392788344064:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560592.680443:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560592.680455:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4463200/0xe34191b05673efe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9222a expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560592.680480:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560592.680512:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:194701de-fe21-4f70-a6ed-c87f3844b85e+9:2342:x1874392788344064:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 78us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560592.680520:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:0.0:1787560592.680538:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:0.0:1787560592.680545:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9adaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:194701de-fe21-4f70-a6ed-c87f3844b85e+8:2342:x1874392788344192:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560592.680557:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560592.680566:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980031600/0xe34191b05673efed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92254 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560592.680577:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560592.680595:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9adaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:194701de-fe21-4f70-a6ed-c87f3844b85e+7:2342:x1874392788344192:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 50us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560592.680602:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:0.0:1787560592.703527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560592.703654:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788344576 00000100:00100000:3.0:1787560592.703678:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788344576 00000100:00100000:3.0:1787560592.703764:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 241 00000100:00100000:3.0:1787560592.703776:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bab96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+6:2341:x1874392788344576:12345-192.168.201.56@tcp:39:umount.0 00000020:00000080:3.0:1787560592.703829:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673effb 00000020:00010000:3.0:1787560592.703840:0:5838:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93d9bb20c000: total 0 00000100:00080000:3.0:1787560592.703883:0:5838:0:(import.c:65:import_set_state_nolock()) ffff93d9bb20b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560592.703916:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1787560592.704527:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93d9bb20c000: total 0 00010000:00010000:0.0:1787560592.704534:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560592.704584:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d9bb20c000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787560592.704627:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d9a1269900) 00010000:00010000:0.0:1787560592.704633:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560592.704643:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb200/0xe34191b05673ff28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9268a expref: 5 pid: 11858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560592.704691:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d9bb20c000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787560592.704701:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560592.704704:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560592.704721:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560592.704806:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bab96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb11441b-9d90-4ed1-83a2-9b2acf931bae+3:2341:x1874392788344576:12345-192.168.201.56@tcp:39:umount.0 Request processed in 1031us (1294us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787560592.704816:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 241 00000100:00100000:2.0:1787560592.772840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560592.773251:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788344832 00000100:00100000:1.0:1787560592.773266:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788344832 00000100:00100000:1.0:1787560592.773387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 305 00000100:00100000:1.0:1787560592.773422:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+7:2341:x1874392788344832:12345-192.168.201.56@tcp:251:umount.0 00000020:00000080:1.0:1787560592.773489:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673eef1 00000020:00010000:1.0:1787560592.773508:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93d9894ce000: total 0 00000100:00080000:1.0:1787560592.773513:0:5832:0:(import.c:65:import_set_state_nolock()) ffff93d9894cb800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787560592.773605:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:194701de-fe21-4f70-a6ed-c87f3844b85e+3:2341:x1874392788344832:12345-192.168.201.56@tcp:251:umount.0 Request processed in 188us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560592.773615:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 305 00000020:00010000:3.0:1787560592.774183:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93d9894ce000: total 0 00010000:00010000:3.0:1787560592.774946:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d9894ce000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787560592.775000:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4462e00/0xe34191b05673ef45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9221c expref: 2 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560592.775023:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d9894ce000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787560592.775037:0:5827:0:(genops.c:885:class_export_put()) final put ffff93d9894ce000/194701de-fe21-4f70-a6ed-c87f3844b85e 00010000:00010000:3.0:1787560592.775060:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560592.775062:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560592.775065:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787560592.775114:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9894ce000/194701de-fe21-4f70-a6ed-c87f3844b85e for MGS 00000020:00000080:2.0:1787560592.775171:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9894cb800 for MGS 00010000:00010000:0.0:1787560593.232171:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560593.625038:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815586944:0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.625147:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560593.625215:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99012f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815587456:0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.625325:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560593.625361:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787560593.625367:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bab94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815587072:0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.625402:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560593.625833:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815587328:0@lo:400:kworker.0 00000100:00100000:2.0:1787560593.625892:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560593.625918:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560593.625924:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815587200:0@lo:400:kworker.0 00000100:00100000:2.0:1787560593.625947:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560593.626523:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b38a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815587584:0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.626562:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815586944 00000100:00100000:0.0:1787560593.626571:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815586944 00000100:00100000:0.0:1787560593.626633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787560593.626871:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815586944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.626945:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815586944:12345-0@lo:400:kworker.0 Request processed in 302us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560593.626954:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787560593.627001:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815587456 00000100:00100000:0.0:1787560593.627005:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815587456 00000100:00100000:0.0:1787560593.627047:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815587072 00000100:00100000:0.0:1787560593.627051:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815587072 00000100:00100000:0.0:1787560593.627070:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815587200 00000100:00100000:0.0:1787560593.627073:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815587200 00000100:00100000:0.0:1787560593.627088:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787560593.627095:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b38a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815587456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.627129:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b38a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815587456:12345-0@lo:400:kworker.0 Request processed in 35us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560593.627153:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787560593.627166:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787560593.627172:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815587072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.627203:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815587072:12345-0@lo:400:kworker.0 Request processed in 32us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560593.627209:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787560593.627220:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787560593.627227:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815587200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.627922:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815587200:12345-0@lo:400:kworker.0 Request processed in 693us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560593.627940:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1787560593.627969:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560593.628020:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560593.628074:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815586944:0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.628090:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99012f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815587456:0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.628117:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bab94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815587072:0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.628135:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815587328 00000100:00100000:0.0:1787560593.628140:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815587328 00000100:00100000:0.0:1787560593.628179:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815587584 00000100:00100000:0.0:1787560593.628182:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815587584 00000100:00100000:0.0:1787560593.628204:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787560593.628211:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815587328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.628261:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815587328:12345-0@lo:400:kworker.0 Request processed in 51us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560593.628278:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787560593.628291:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787560593.628297:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815587584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560593.628338:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815587584:12345-0@lo:400:kworker.0 Request processed in 41us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560593.628344:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1787560593.628366:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560593.628369:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560593.628384:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b38a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815587584:0@lo:400:kworker.0 00000100:00100000:2.0:1787560593.628575:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815587200:0@lo:400:kworker.0 00000100:00100000:2.0:1787560593.628587:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815587328:0@lo:400:kworker.0 00000001:00080000:1.0:1787560593.678025:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1787560593.678051:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bb11441b-9d90-4ed1-83a2-9b2acf931bae 00000001:00080000:1.0:1787560593.678061:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787560593.678065:0:5859:0:(genops.c:885:class_export_put()) final put ffff93d9bb20c000/bb11441b-9d90-4ed1-83a2-9b2acf931bae 00000001:00100000:1.0:1787560593.678082:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000001:00080000:1.0:1787560593.678087:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787560593.678113:0:5859:0:(genops.c:885:class_export_put()) final put ffff93d881255800/3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:1.0:1787560593.678129:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9bb20c000/bb11441b-9d90-4ed1-83a2-9b2acf931bae for lustre-MDT0000 00000020:00000080:1.0:1787560593.678198:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff93d881255800/3e6b7760-d76b-45e8-8d98-861d14ecc789 for lustre-MDT0000 00000020:00000080:1.0:1787560593.678240:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9bb20b800 for lustre-MDT0000 00000020:00000080:1.0:1787560593.678246:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d881251800 for lustre-MDT0000 00000001:00100000:0.0:1787560593.691331:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:0.0:1787560593.691344:0:6708:0:(genops.c:885:class_export_put()) final put ffff93d9b3810000/3e6b7760-d76b-45e8-8d98-861d14ecc789 00000020:00000080:1.0:1787560593.691565:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b3810000/3e6b7760-d76b-45e8-8d98-861d14ecc789 for lustre-OST0000 00000020:00000080:1.0:1787560593.691659:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9b3816800 for lustre-OST0000 00000100:00100000:2.0:1787560594.129016:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787560594.129048:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815587712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560594.129316:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560594.140298:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815587712 00000100:00100000:0.0:1787560594.140321:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815587712 00000100:00100000:0.0:1787560594.140414:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787560594.140427:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815587712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560594.140479:0:6687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560594.140587:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815587712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (11270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560594.140595:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787560594.142034:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815587712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787560594.257681:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787560595.004060:0:12913:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787560595.041473:0:12913:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787560595.041527:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.041542:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.041549:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.041569:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.041598:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787560595.041604:0:12913:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787560595.041627:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787560595.041632:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787560595.041638:0:12913:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787560595.041666:0:12913:0:(import.c:65:import_set_state_nolock()) ffff93d9b1cb7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787560595.041737:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560595.041750:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.041757:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4462200 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:3.0:1787560595.041760:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.041769:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560595.041776:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560595.041781:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560595.041784:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787560595.041786:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787560595.041812:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.041818:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560595.041867:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.041875:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9b4462200/0xe34191b05673ef84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ef8b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.041886:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560595.041888:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560595.041890:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560595.041938:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bad4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815587968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560595.042004:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560595.042105:0:7630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815587968 00000100:00100000:3.0:1787560595.042112:0:7630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815587968 00000100:00100000:3.0:1787560595.042168:0:7630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560595.042185:0:7630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3314:x1874392815587968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560595.042199:0:7630:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560595.042214:0:7630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21da400/0xe34191b05673ef8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673ef84 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.042225:0:7630:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560595.042275:0:7630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:3314:x1874392815587968:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560595.042283:0:7630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560595.042319:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bad4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3314:1874392815587968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560595.042615:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874392815587840:0@lo:39:umount.0 00000100:00100000:1.0:1787560595.042651:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560595.042925:0:11858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815587840 00000100:00100000:0.0:1787560595.042930:0:11858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815587840 00000100:00100000:0.0:1787560595.042971:0:11858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787560595.042979:0:11858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874392815587840:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787560595.043001:0:11858:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ed00 00000100:00080000:0.0:1787560595.043009:0:11858:0:(import.c:65:import_set_state_nolock()) ffff93d9b3ec6000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787560595.043069:0:11858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1874392815587840:12345-0@lo:39:umount.0 Request processed in 90us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560595.043076:0:11858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787560595.043085:0:11858:0:(genops.c:885:class_export_put()) final put ffff93d9b3ec2000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787560595.043318:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787560595.043328:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b3ec2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787560595.043394:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9b3ec6000 for lustre-MDT0000 00000100:00080000:3.0:1787560595.044011:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9b1cb7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787560595.044028:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874392815587840:0@lo:39:umount.0 00000100:00080000:0.0:1787560595.044073:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787560595.044076:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787560595.044081:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787560595.045710:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.045726:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.045753:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.045760:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.045817:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560595.045823:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.045830:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.045836:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.045843:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.050996:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560595.051013:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.051027:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c4e00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560595.051031:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.051060:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560595.051067:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560595.051073:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787560595.051076:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787560595.051117:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.051124:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560595.051150:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.051157:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9829c4e00/0xe34191b05673ef92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ef99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.051176:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560595.051181:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.051187:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030400 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560595.051190:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.051198:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560595.051205:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560595.051216:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787560595.051219:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787560595.051232:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.051238:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560595.051262:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.051270:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560595.051272:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560595.051274:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560595.051300:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815588096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560595.051385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560595.052570:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815588224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560595.059603:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560595.059626:0:12913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d980030400/0xe34191b05673eeab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673eeb2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560595.059653:0:12913:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787560595.059686:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.059695:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.059721:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.059728:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.059746:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560595.059752:0:12913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.059759:0:12913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.059766:0:12913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.059772:0:12913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560595.059798:0:12913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787560595.059802:0:12913:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787560595.059805:0:12913:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787560595.059835:0:12913:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787560595.059839:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787560595.059844:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560595.059862:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787560595.059868:0:12913:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93d99859b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:3.0:1787560595.059869:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787560595.059873:0:12913:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff93d986430000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787560595.059886:0:12913:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff93d986420000) has exports, disconnecting them 00000020:00080000:0.0:1787560595.059891:0:12913:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d99859b000), last request at 1787560593 00000020:00000080:0.0:1787560595.059900:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ee73 00000100:00080000:0.0:1787560595.059920:0:12913:0:(import.c:65:import_set_state_nolock()) ffff93d99859f000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787560595.059956:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815588096 00000100:00100000:3.0:1787560595.059965:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815588096 00000020:00080000:0.0:1787560595.059973:0:12913:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d99859b000): rc 0 00000020:00000080:0.0:1787560595.059976:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d99859b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787560595.059985:0:12913:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff93d986430000), last request at 1787560593 00000020:00000080:0.0:1787560595.059988:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673eda8 00000100:00080000:0.0:1787560595.059992:0:12913:0:(import.c:65:import_set_state_nolock()) ffff93d991f49000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787560595.060001:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d99859b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1787560595.060011:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815588224 00000100:00100000:3.0:1787560595.060014:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815588224 00000100:00100000:3.0:1787560595.060034:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787560595.060044:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+19:3311:x1874392815588096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560595.060058:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1787560595.060058:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d99859f000 for lustre-MDT0000 00000020:00080000:0.0:1787560595.060069:0:12913:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d986430000): rc 0 00000020:00000080:0.0:1787560595.060072:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d986430000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1787560595.060074:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4463800/0xe34191b05673ef99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673ef92 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1787560595.060081:0:12913:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb1f01c9fae0 00010000:00010000:3.0:1787560595.060085:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:0.0:1787560595.060091:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986430000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787560595.060117:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d991f49000 for lustre-MDT0000 00000100:00100000:3.0:1787560595.060123:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+18:3311:x1874392815588096:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (8739us total) trans 0 rc 0/0 00000100:00080000:0.0:1787560595.060135:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787560595.060138:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787560595.060139:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787560595.060150:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787560595.060155:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787560595.060161:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:3312:x1874392815588224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560595.060168:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560595.060176:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21daa00/0xe34191b05673eeb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673eeab expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.060187:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560595.060215:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3312:x1874392815588224:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560595.060221:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787560595.060221:0:12913:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787560595.060242:0:12913:0:(import.c:65:import_set_state_nolock()) ffff93d986ac9800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787560595.060258:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787560595.060260:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000100:00100000:3.0:1787560595.060266:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815588224:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1787560595.060268:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787560595.060291:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815588352:0@lo:9:umount.0 00000100:00080000:0.0:1787560595.060321:0:12913:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787560595.060326:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787560595.060328:0:12913:0:(import.c:65:import_set_state_nolock()) ffff93d9bf87b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787560595.060350:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815588480:0@lo:9:umount.0 00000020:00080000:0.0:1787560595.060383:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93d986420000) has no exports 00000100:00100000:3.0:1787560595.060515:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560595.060550:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815588352 00000100:00100000:3.0:1787560595.060555:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815588352 00000100:00100000:3.0:1787560595.060591:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815588480 00000100:00100000:3.0:1787560595.060594:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815588480 00000100:00100000:3.0:1787560595.060615:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787560595.060621:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bad4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874392815588352:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787560595.060644:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673edf5 00000100:00080000:3.0:1787560595.060650:0:6683:0:(import.c:65:import_set_state_nolock()) ffff93d9ad960800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560595.060676:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787560595.061037:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bad4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1874392815588352:12345-0@lo:9:umount.0 Request processed in 414us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560595.061051:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787560595.061065:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787560595.061071:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874392815588480:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787560595.061082:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673eedc 00000100:00080000:3.0:1787560595.061086:0:6683:0:(import.c:65:import_set_state_nolock()) ffff93d882dfc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560595.061098:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787560595.061259:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1874392815588480:12345-0@lo:9:umount.0 Request processed in 187us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560595.061265:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1787560595.061591:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560595.061599:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.061608:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c4a00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560595.061612:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.061621:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560595.061627:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560595.061632:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787560595.061642:0:7629:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787560595.061645:0:7629:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787560595.061672:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.061679:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560595.061708:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.061716:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9829c4a00/0xe34191b05673f19f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673f1a6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.061729:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560595.061733:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.061738:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9829c4800 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560595.061741:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.061747:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560595.061754:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560595.061758:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787560595.061761:0:7629:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787560595.061763:0:7629:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787560595.061775:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.061791:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560595.061799:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.061805:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9829c4800/0xe34191b05673ec5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ec66 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.061819:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560595.061820:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560595.061822:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560595.061840:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815588608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560595.061886:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560595.061900:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560595.061944:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787560595.061950:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560595.061950:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815588736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560595.061961:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815588608 00000100:00100000:2.0:1787560595.061967:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815588608 00000100:00100000:0.0:1787560595.061971:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560595.061992:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815588736 00000100:00100000:2.0:1787560595.061995:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815588736 00000100:00100000:2.0:1787560595.062007:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560595.062014:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+17:3313:x1874392815588608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560595.062023:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560595.062035:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c5e00/0xe34191b05673f1a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673f19f expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560595.062047:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560595.062103:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787560595.062112:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+16:3313:x1874392815588736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560595.062121:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560595.062130:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c4000/0xe34191b05673ec66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673ec5f expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560595.062142:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1787560595.062195:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560595.062200:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560595.062252:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9bf87b000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787560595.062259:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787560595.062261:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787560595.062264:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815588480:0@lo:9:umount.0 00000100:00080000:3.0:1787560595.062277:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d986ac9800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787560595.062291:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787560595.062292:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787560595.062295:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815588352:0@lo:9:umount.0 00000100:00100000:2.0:1787560595.065255:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ba37d386-11cd-48cd-b42f-22b3cfa8191f+15:3313:x1874392815588608:12345-0@lo:103:ldlm_bl.0 Request processed in 3216us (3328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560595.065295:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560595.065657:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ba37d386-11cd-48cd-b42f-22b3cfa8191f+14:3313:x1874392815588736:12345-0@lo:103:ldlm_bl.0 Request processed in 3544us (3682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560595.065665:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560595.071328:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815588736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560595.073177:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815588608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560595.073434:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3311:1874392815588096:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787560595.079134:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff93d986420000) has no exports 00000020:00000080:0.0:1787560595.163998:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ecba 00000020:00000080:0.0:1787560595.164017:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d9b3ec3800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787560595.164235:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787560595.165003:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b3ec3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787560595.165034:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560595.165045:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787560595.165049:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff93d990184d28) has no exports 00000020:00000080:1.0:1787560595.165528:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ecb3 00000020:00000080:1.0:1787560595.165536:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d9b5676000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787560595.165599:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560595.165622:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787560595.165625:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d9b5675800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787560595.165628:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b5675800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787560595.165632:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787560595.165706:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b5676000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787560595.165782:0:12913:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d998481f60 - data ffff93d987452ca8/ffff93d9bb0ac000 00000020:01000000:1.0:1787560595.165966:0:12913:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d9a5daaa80 - data ffff93d9a7bb0000/ffff93d9b50c9400 00000001:00000004:1.0:1787560595.196143:0:12913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:0.0:1787560595.279497:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560595.322226:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787560595.322236:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787560595.322252:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787560595.322254:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787560595.323835:0:6859:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787560595.323841:0:6859:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787560595.323876:0:6859:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787560595.324941:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787560595.324947:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787560595.324971:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787560595.324981:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787560595.326768:0:7931:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787560595.326775:0:7931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787560595.326786:0:7931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787560595.445728:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ec82 00000020:00000080:3.0:1787560595.445742:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d99859e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787560595.447153:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ec97 00000020:00000080:3.0:1787560595.447163:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d99859d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787560595.447171:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787560595.447178:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560595.447188:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787560595.447192:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff93d986424d28) has no exports 00000004:01000000:3.0:1787560595.447377:0:12913:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787560595.447385:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673eed5 00000020:00000080:3.0:1787560595.447390:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d9bf87d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787560595.447498:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d99859e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787560595.447524:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d99859d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787560595.447928:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787560595.447935:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560595.447942:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787560595.447945:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff93d882264d28) has no exports 00000020:00000080:3.0:1787560595.447952:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673eece 00000020:00000080:3.0:1787560595.447956:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d9bf879000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787560595.448326:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9bf87d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787560595.448343:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9bf879000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787560595.448702:0:12913:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787560595.448707:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787560595.448711:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787560595.448716:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787560595.448719:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787560595.449069:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560595.449079:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787560595.449086:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673edee 00000020:00000080:3.0:1787560595.449092:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d9bfc6f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787560595.449147:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9bf87b000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787560595.449154:0:38:0:(genops.c:885:class_export_put()) final put ffff93d881853800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787560595.449156:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d881853800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787560595.449172:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787560595.449793:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787560595.449799:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560595.449805:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787560595.449809:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff93d8812a8000) has no exports 00000020:00000080:3.0:1787560595.449818:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ede7 00000020:00000080:3.0:1787560595.449823:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d986aca000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1787560595.450207:0:12913:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787560595.450210:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787560595.450214:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787560595.450218:0:12913:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787560595.450220:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787560595.450487:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560595.450494:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787560595.450586:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560595.450591:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787560595.450594:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d9ba32e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560595.450596:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9ba32e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787560595.450601:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9bfc6f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787560595.450603:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787560595.450615:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986aca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787560595.450619:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d986ac9800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787560595.450625:0:38:0:(genops.c:885:class_export_put()) final put ffff93d881253800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787560595.450626:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d881253800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787560595.450630:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787560595.451107:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ec9e 00000020:00000080:3.0:1787560595.451112:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d998599800/lustre-MDD0000_UUID 00000020:01000000:3.0:1787560595.451164:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787560595.451169:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560595.451173:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787560595.451176:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff93d9864219b8) has no exports 00000020:00000080:3.0:1787560595.451197:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560595.451200:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787560595.451204:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673eca5 00000020:00000080:3.0:1787560595.451207:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d99859e000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787560595.451870:0:12913:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d982bfc800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787560595.451876:0:12913:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d982bfc800 3 00000020:01000004:3.0:1787560595.451879:0:12913:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d982bfc800 from lustre-MDT0000 00000020:00000080:3.0:1787560595.451905:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560595.451909:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787560595.451912:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d998598000/lustre-MDT0000_UUID 00000020:00000080:3.0:1787560595.451915:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff93d998598000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787560595.451923:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787560595.451959:0:12913:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787560595.451964:0:12913:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787560595.451976:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787560595.451979:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560595.451981:0:12913:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787560595.451988:0:12913:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff93d987d6f000 ba37d386-11cd-48cd-b42f-22b3cfa8191f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560595.451994:0:12913:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff93d9901eb370) has exports, disconnecting them 00000020:00080000:3.0:1787560595.451998:0:12913:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff93d987d6f000), last request at 1787560357 00000020:00000080:3.0:1787560595.452014:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ec43 00000020:00010000:3.0:1787560595.452018:0:12913:0:(genops.c:1921:obd_stale_export_put()) Put export ffff93d987d6f000: total 2 00000100:00080000:3.0:1787560595.452022:0:12913:0:(import.c:65:import_set_state_nolock()) ffff93d987d6d800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787560595.452038:0:12913:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d987d6f000): rc 0 00000020:00080000:3.0:1787560595.452042:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff93d9901eb370) has no exports 00000020:00010000:3.0:1787560595.452055:0:5827:0:(genops.c:1907:obd_stale_export_get()) Get export ffff93d987d6f000: total 2 00010000:00010000:3.0:1787560595.452076:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff93d987d6f000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787560595.452103:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c5000/0xe34191b05673ef53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673ef4c expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.452120:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21db400/0xe34191b05673ef6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673ef68 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.452130:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21da600/0xe34191b05673ef61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673ef5a expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.452141:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4462800/0xe34191b05673ef7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673ef76 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.452152:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9829c5a00/0xe34191b05673f18a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673f183 expref: 5 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.452161:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98a711400/0xe34191b05673f198 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673f191 expref: 4 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.452188:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4463c00/0xe34191b05673efa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673efa0 expref: 3 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.452199:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d980030200/0xe34191b05673ed5b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe34191b05673ed54 expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560595.452208:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff93d987d6f000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787560595.452222:0:5827:0:(genops.c:885:class_export_put()) final put ffff93d987d6f000/ba37d386-11cd-48cd-b42f-22b3cfa8191f 00010000:00010000:3.0:1787560595.452228:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560595.452230:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560595.452232:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560595.452898:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff93d99019ea00:5833] 2 exiting: rc = 0 00000100:00100000:1.0:1787560595.453030:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff93d99019e600:5832] 1 exiting: rc = 0 00000100:00100000:3.0:1787560595.454979:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff93d99019e400:5831] 0 exiting: rc = 1 00000100:00100000:1.0:1787560595.455128:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455137:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455145:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455151:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455157:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455162:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455168:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455174:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455202:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455207:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455214:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455221:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455227:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455233:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455251:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455258:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455264:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455270:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455276:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455284:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455289:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455297:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455304:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455309:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455315:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455320:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455325:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455456:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455465:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455471:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455476:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455481:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455486:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455492:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455500:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455571:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455577:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455582:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455587:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455592:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455598:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455603:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455608:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455686:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455692:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455697:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455703:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455708:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455714:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455720:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455726:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455732:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455737:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455743:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455749:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455755:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455760:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455766:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455772:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455777:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455782:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455788:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455793:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.455799:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787560595.456204:0:12913:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787560595.456208:0:12913:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1787560595.459342:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d998599800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787560595.459777:0:38:0:(genops.c:885:class_export_put()) final put ffff93d99859c000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787560595.459780:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d99859c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787560595.459893:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787560595.460227:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d99859e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787560595.460234:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d987d6f000/ba37d386-11cd-48cd-b42f-22b3cfa8191f for MGS 00000020:00000080:1.0:1787560595.460286:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d987d6d800 for MGS 00000020:01000000:3.0:1787560595.460370:0:12913:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d9904bd600 - data ffff93d9a7bb8ca8/ffff93d881d90c00 00000020:01000000:3.0:1787560595.460522:0:12913:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d995c3bd80 - data ffff93d9a7966438/ffff93d989463c00 00000020:00000080:3.0:1787560595.461233:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ec27 00000020:00000080:3.0:1787560595.461240:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d983e66000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787560595.461255:0:12913:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d982bfc800 from MGS, refs=2 00000020:01000004:3.0:1787560595.461259:0:12913:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d982bfc800 2 00000020:01000004:3.0:1787560595.461262:0:12913:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d982bfc800 from MGS 00000020:00000080:0.0:1787560595.461263:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d983e66000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787560595.461290:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560595.461298:0:12913:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787560595.461301:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d983e61000/MGS 00000020:00000080:3.0:1787560595.461303:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff93d983e61000/MGS for MGS 00000020:01000000:3.0:1787560595.461308:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787560595.461463:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787560595.461467:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560595.461473:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787560595.461479:0:12913:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff93d9b5682000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560595.461498:0:12913:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff93d990180000) has exports, disconnecting them 00000020:00080000:3.0:1787560595.461722:0:12913:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff93d9b5682000), last request at 1787560358 00000020:00000080:3.0:1787560595.461728:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ecf2 00000020:00080000:3.0:1787560595.461738:0:12913:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d9b5682000): rc 0 00000020:00000080:3.0:1787560595.461742:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d9b5682000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787560595.461999:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b5682000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787560595.530953:0:12913:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787560595.530963:0:12913:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787560595.530967:0:12913:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787560595.530990:0:12913:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787560595.531191:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560595.531201:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787560595.531208:0:12913:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d982bfc800 1 00000020:00000080:0.0:1787560595.531215:0:12913:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ec19 00000020:00000080:0.0:1787560595.531224:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d983e63800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787560595.531229:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787560595.531235:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560595.531255:0:12913:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787560595.531259:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff93d990183370) has no exports 00000020:00000080:1.0:1787560595.533143:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9b1cb7000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787560595.533156:0:37:0:(genops.c:885:class_export_put()) final put ffff93d9b5680000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787560595.533160:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b5680000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787560595.533173:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787560595.533229:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d983e63800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787560595.577969:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560595.577986:0:12913:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787560595.578004:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d9904dd800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787560595.578009:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9904dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787560595.578017:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787560595.578134:0:12913:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d982bfd800 00000020:01000000:1.0:1787560595.578156:0:12913:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787560595.578160:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560595.578164:0:12913:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787560595.578168:0:12913:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff93d986423370) has no exports 00000100:00100000:2.0:1787560595.581982:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff93d990586a00:5839] 2 exiting: rc = 0 00000100:00100000:2.0:1787560595.582085:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93d99044cc00:5837] 0 exiting: rc = 1 00000100:00100000:1.0:1787560595.582427:0:6706:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93d8811c3200:6706] 3 exiting: rc = 0 00000100:00100000:1.0:1787560595.584130:0:11858:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff93d9bb203200:11858] 4 exiting: rc = 0 00000100:00100000:1.0:1787560595.584227:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff93d990586600:5838] 1 exiting: rc = 0 00000100:00100000:1.0:1787560595.584303:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584311:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584317:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584323:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584328:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584333:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584337:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584343:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584348:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584363:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584384:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584392:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584399:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584405:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584411:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584416:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584421:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584427:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584432:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584436:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584441:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584447:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584453:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584471:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584477:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584483:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584489:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584495:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584500:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584506:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584511:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584517:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584522:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584528:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584533:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584537:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584542:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584547:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584552:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584557:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584562:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584567:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584572:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584577:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584587:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584593:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584598:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584603:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584608:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584628:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584635:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584641:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584646:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584652:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584658:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584664:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584669:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584674:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584686:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584695:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584701:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584707:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584713:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560595.584719:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.605902:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93d990586e00:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1787560595.611939:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff93d990586800:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1787560595.613898:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613908:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613915:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613922:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613928:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613934:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613940:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613946:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613952:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613958:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613964:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613970:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613978:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613984:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613990:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.613996:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614002:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614008:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614014:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614019:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614024:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614029:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614034:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614055:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614060:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614067:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614072:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614078:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614083:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614090:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614095:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614100:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614105:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614110:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614115:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614120:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614125:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614129:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614134:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614139:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614143:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614148:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614152:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614157:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614162:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614167:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614172:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614177:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614182:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614187:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614191:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614196:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614201:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614205:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614209:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614214:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614219:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614223:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614232:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614237:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614241:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614247:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614253:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.614258:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.617790:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff93d9900c7e00:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1787560595.618008:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93d9904fd000:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1787560595.618107:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618124:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618147:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618153:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618158:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618165:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618171:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618177:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618183:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618189:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618195:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618200:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618205:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618211:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618232:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618239:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618246:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618252:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618259:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618264:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618270:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618276:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618282:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618288:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618296:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618302:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618322:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618731:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618754:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618760:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618765:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618772:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618777:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618783:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618790:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618796:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618801:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618807:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618830:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618837:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618842:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618871:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618878:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618884:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618889:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618895:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618901:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618906:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618911:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618917:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618941:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618947:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618954:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618960:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618967:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618974:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618979:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618985:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618991:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.618996:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.619001:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.619010:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.619032:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.619044:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.648939:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff93d9900c7000:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1787560595.649073:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff93d9900c7600:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1787560595.649370:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649377:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649382:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649387:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649393:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649399:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649404:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649409:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649414:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649419:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649721:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649731:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649736:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649741:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649746:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649750:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649755:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649759:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649764:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649769:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649773:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649778:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649783:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649787:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649792:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649796:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649801:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649805:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649810:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649814:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649818:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649823:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649827:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649831:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649863:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649869:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649875:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649880:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649886:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649891:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649896:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649901:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649907:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649913:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649918:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649923:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649928:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649932:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649937:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649942:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649952:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649960:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649965:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649970:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649975:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649980:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649985:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649991:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.649996:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.650000:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.650005:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.650010:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.650014:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.650019:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.650454:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff93d9900c6200:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1787560595.650552:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff93d9900c6c00:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1787560595.651663:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651671:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651677:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651682:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651687:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651704:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651709:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651714:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651718:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651723:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651728:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651733:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651738:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651742:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651747:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651751:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651756:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651761:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651765:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651769:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651773:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651778:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651782:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651787:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651791:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651797:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651801:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651805:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651810:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651814:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651818:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651822:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651826:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651831:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651842:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651865:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651870:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651876:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651881:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651886:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.651898:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652136:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652140:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652145:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652149:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652154:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652165:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652175:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652180:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652185:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652191:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652197:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652202:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652207:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652212:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652218:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652222:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652227:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652232:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652237:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652241:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652245:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652250:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.652255:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.655752:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93d9b1d99600:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1787560595.657762:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff93d9b1c48600:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1787560595.663772:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663783:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663794:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663799:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663806:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663811:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663817:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663822:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663827:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663832:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663837:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663871:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663876:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663881:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663886:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663891:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663901:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663906:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663913:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663918:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663923:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663928:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663933:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663937:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663942:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663946:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663951:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663955:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663960:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663964:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663969:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663973:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663977:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663982:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663988:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663992:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.663996:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664001:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664005:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664010:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664014:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664019:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664023:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664027:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664031:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664037:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664049:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664053:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664058:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664063:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664068:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664073:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664078:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664083:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664088:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664097:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664101:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664108:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664113:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664118:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664122:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664127:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664132:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560595.664136:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665363:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93d9ba31c200:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1787560595.665616:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff93d9b1cfdc00:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1787560595.665804:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93d9ba31da00:5852] 2 exiting: rc = 0 00000100:00100000:3.0:1787560595.665892:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665900:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665906:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665911:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665917:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665923:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665929:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665935:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665941:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665966:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665972:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665977:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665982:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665987:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665992:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.665997:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666002:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666007:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666012:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666017:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666022:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666100:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666108:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666124:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666129:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666134:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666140:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666145:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666151:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666155:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666161:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666166:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666171:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666188:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666194:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666199:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666204:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666210:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666215:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666221:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666226:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666231:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666237:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666243:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666248:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666255:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666260:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666265:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666271:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666277:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666282:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666287:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666293:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666299:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666304:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666310:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666316:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666321:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666797:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666802:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666807:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666812:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666817:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560595.666823:0:12913:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787560595.671364:0:12913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560595.671377:0:12913:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787560595.671383:0:12913:0:(genops.c:885:class_export_put()) final put ffff93d991f48800/MDS_uuid 00000020:00000080:3.0:1787560595.671538:0:12913:0:(genops.c:844:class_export_destroy()) destroying export ffff93d991f48800/MDS_uuid for MDS 00000020:01000000:3.0:1787560595.671549:0:12913:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787560595.671682:0:12913:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:0.0:1787560596.292947:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787560596.292957:0:7642:0:(genops.c:885:class_export_put()) final put ffff93d882dfb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560596.295740:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d882dfb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787560596.298678:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d882dfc000 for lustre-OST0001 00010000:00010000:0.0:1787560596.303041:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560597.332073:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560598.351258:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560598.759145:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874392815588992:0@lo:400:kworker.0 00000400:00000100:0.0:1787560598.759199:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392815588992 offset 0 length 224: 4 00000100:00100000:0.0:1787560598.759249:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560598.759256:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815588864:0@lo:400:kworker.0 00000400:00000100:0.0:1787560598.759277:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874392815588864 offset 0 length 224: 4 00000100:00100000:0.0:1787560598.759313:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815589120:0@lo:400:kworker.0 00000400:00000100:0.0:1787560598.759331:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392815589120 offset 0 length 224: 4 00000001:00100000:3.0:1787560598.871909:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560598.871918:0:6708:0:(genops.c:885:class_export_put()) final put ffff93d9ad961000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560598.871954:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9ad961000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787560598.872003:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d9ad960800 for lustre-OST0000 00010000:00010000:0.0:1787560599.385876:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787560599.445527:0:13066:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787560599.456057:0:13066:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787560599.456100:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560599.456115:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560599.456122:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560599.456129:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560599.456147:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787560599.456152:0:13066:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787560599.456174:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787560599.456185:0:13066:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9b3921180 x1874392815588992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560614 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560599.456208:0:13066:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787560599.456222:0:13066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787560599.456245:0:13066:0:(import.c:65:import_set_state_nolock()) ffff93d881253000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787560599.456296:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874392815589248:0@lo:39:umount.0 00000400:00000100:2.0:1787560599.456368:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392815589248 offset 0 length 224: 4 00000100:00100000:1.0:1787560599.456542:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874392815588992:0@lo:400:kworker.0 00010000:00010000:0.0:1787560599.458971:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560599.458982:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560599.458995:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dbc00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560599.458999:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560599.459008:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560599.459015:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560599.459021:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787560599.459024:0:7629:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787560599.459027:0:7629:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787560599.459064:0:7629:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560599.459071:0:7629:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560599.459100:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560599.459107:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21dbc00/0xe34191b05673ef68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe34191b05673ef6f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560599.459122:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560599.459123:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560599.459125:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560599.460358:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560599.460381:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815589376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560599.460465:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560599.462003:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815589376 00000100:00100000:0.0:1787560599.462017:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815589376 00000100:00100000:0.0:1787560599.462068:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560599.462077:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1874392815589376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787560599.462084:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560599 with bad export cookie 16375529906646543427 00000100:00100000:0.0:1787560599.484086:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1874392815589376:12345-0@lo:103:ldlm_bl.0 Request processed in 22001us (23612us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787560599.484100:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787560599.484640:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.156@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787560599.484654:0:3313:0:(import.c:65:import_set_state_nolock()) ffff93d98949b000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787560599.484659:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787560599.493489:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.156@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787560599.493495:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787560599.493505:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9b3923800 x1874392815588864/t0(0) o400->MGC192.168.201.156@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787560614 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560599.493530:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9b3920380 x1874392815589376/t0(0) o103->MGC192.168.201.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560615 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787560599.493540:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00100000:0.0:1787560599.493580:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3312:1874392815588864:0@lo:400:kworker.0 00000100:00080000:1.0:1787560599.493597:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787560599.493599:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787560599.493603:0:3313:0:(import.c:65:import_set_state_nolock()) ffff93d98949b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560599.493609:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.201.156@tcp: connect to NID 0@lo last attempt 186 00000100:00080000:1.0:1787560599.493618:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.201.156@tcp: import ffff93d98949b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1787560599.493722:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d99840ed80 x1874392815589504/t0(0) o250->MGC192.168.201.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560599.493779:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3310:1874392815589504:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787560599.493822:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874392815589504 offset 0 length 520: 4 00000100:00100000:1.0:1787560599.494144:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3313:1874392815589376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560600.399185:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560601.423302:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560602.447156:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560603.471107:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560603.855195:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560603.855218:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787560603.855613:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560603.855641:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815589632:0@lo:400:kworker.0 00000400:00000100:0.0:1787560603.855724:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392815589632 offset 0 length 224: 4 00010000:00010000:0.0:1787560604.500914:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787560604.883058:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560604.883068:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787560604.883274:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560604.883422:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815589760:0@lo:400:kworker.0 00000400:00000100:3.0:1787560604.883503:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392815589760 offset 0 length 224: 4 00010000:00010000:0.0:1787560605.527313:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560606.543789:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560607.567260:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560608.591088:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560609.616972:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560609.999914:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560609.999931:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560610.000211:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815589888:0@lo:400:kworker.0 00000400:00000100:1.0:1787560610.000295:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392815589888 offset 0 length 224: 4 00000100:00100000:2.0:1787560610.000442:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560599/real 1787560599] req@ffff93d99840ed80 x1874392815589504/t0(0) o250->MGC192.168.201.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787560609 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560610.000471:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d99840ed80 x1874392815589504/t0(0) o250->MGC192.168.201.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787560609 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560610.000484:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560599/real 1787560599] req@ffff93d986a00380 x1874392815589248/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560609 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560610.000497:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d986a00380 x1874392815589248/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560609 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787560610.000512:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d98949b000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560610.000532:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787560610.000537:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3310:1874392815589504:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1787560610.000543:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d881253000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787560610.000561:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874392815589248:0@lo:39:umount.0 00000100:00080000:0.0:1787560610.000590:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560610.000595:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787560610.000598:0:37:0:(import.c:65:import_set_state_nolock()) ffff93d98949b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787560610.000604:0:37:0:(import.c:510:import_select_connection()) MGC192.168.201.156@tcp: connect to NID 0@lo last attempt 428 00000100:00080000:0.0:1787560610.000610:0:37:0:(import.c:589:import_select_connection()) MGC192.168.201.156@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787560610.000620:0:37:0:(import.c:624:import_select_connection()) MGC192.168.201.156@tcp: import ffff93d98949b000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1787560610.000643:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9b3922d80 x1874392815590016/t0(0) o250->MGC192.168.201.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560610.000761:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787560610.000771:0:13066:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787560610.000777:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1787560610.000794:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3310:1874392815590016:0@lo:250:kworker.0 00000400:00000100:2.0:1787560610.000826:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874392815590016 offset 0 length 520: 4 00010000:00010000:1.0:1787560610.001738:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560610.001756:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560610.001766:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560610.001774:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560610.001806:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560610.001815:0:13066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560610.001822:0:13066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560610.001828:0:13066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560610.001838:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560610.001865:0:13066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560610.001866:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560610.001875:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4462600 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560610.001879:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560610.001890:0:13066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560610.001890:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560610.001895:0:13066:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:00010000:0.0:1787560610.001898:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560610.001904:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787560610.001907:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787560610.001910:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000004:1.0:1787560610.001927:0:13066:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1787560610.001929:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d98949b000 00000020:01000000:1.0:1787560610.001931:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:0.0:1787560610.001933:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787560610.001936:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1787560610.001940:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9b4462600/0xe34191b05673ef76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673ef7d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787560610.001943:0:13066:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787560610.001949:0:13066:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93d9901819b8) has no exports 00010000:00010000:0.0:1787560610.001959:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560610.001962:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560610.001967:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980031a00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560610.001976:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787560610.001982:0:13066:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff93d9901819b8) has no exports 00010000:00010000:0.0:1787560610.001983:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560610.001989:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560610.001994:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787560610.001996:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787560610.001997:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787560610.002001:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d98949b000 00010000:00010000:0.0:1787560610.002004:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560610.002011:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d980031a00/0xe34191b05673f191 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673f198 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560610.002021:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560610.002023:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560610.002025:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560610.002073:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787560610.018929:0:13066:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d9984810c0 - data ffff93d9877d9798/ffff93d9bad6f400 00000020:01000000:1.0:1787560610.019182:0:13066:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d9ba883f60 - data ffff93d987756000/ffff93d9bfaea000 00100000:10000000:1.0:1787560610.034807:0:13066:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787560610.107040:0:13066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ed77 00000020:00000080:1.0:1787560610.107052:0:13066:0:(genops.c:885:class_export_put()) final put ffff93d9ad964000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787560610.107067:0:13066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d986ace800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787560610.107071:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d986ace800 2 00000020:01000004:1.0:1787560610.107075:0:13066:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d986ace800 from lustre-OST0000 00000020:00000080:1.0:1787560610.107114:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560610.107127:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787560610.107130:0:13066:0:(genops.c:885:class_export_put()) final put ffff93d9ad962000/lustre-OST0000_UUID 00000020:00000080:1.0:1787560610.107134:0:13066:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9ad962000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787560610.107151:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787560610.107205:0:13066:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787560610.107209:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787560610.107214:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560610.107219:0:13066:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787560610.107228:0:13066:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff93d986431800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787560610.107249:0:13066:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff93d8812acd28) has exports, disconnecting them 00000020:00080000:1.0:1787560610.107255:0:13066:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff93d986431800), last request at 1787560377 00000020:00000080:1.0:1787560610.107260:0:13066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673eda1 00000020:00080000:1.0:1787560610.107269:0:13066:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d986431800): rc 0 00000020:00000080:1.0:1787560610.107273:0:13066:0:(genops.c:885:class_export_put()) final put ffff93d986431800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787560610.108176:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9ad964000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787560610.108195:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986431800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787560610.113436:0:13066:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787560610.113448:0:13066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787560610.113453:0:13066:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787560610.113465:0:13066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787560610.113692:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560610.113703:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787560610.113712:0:13066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d986ace800 1 00000020:00000080:2.0:1787560610.113721:0:13066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ed31 00000020:00000080:2.0:1787560610.113732:0:13066:0:(genops.c:885:class_export_put()) final put ffff93d986ac8800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787560610.113738:0:13066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787560610.113749:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787560610.113754:0:13066:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787560610.113758:0:13066:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff93d9901e8000) has no exports 00000020:00000080:3.0:1787560610.114969:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d881253000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787560610.114982:0:37:0:(genops.c:885:class_export_put()) final put ffff93d881252000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787560610.114985:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d881252000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787560610.115001:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787560610.115071:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986ac8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787560610.149325:0:13066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560610.149341:0:13066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787560610.149347:0:13066:0:(genops.c:885:class_export_put()) final put ffff93d986ac9000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787560610.149351:0:13066:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986ac9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787560610.149430:0:13066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787560610.149585:0:13066:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d986acc000 00000020:02000400:2.0:1787560610.149633:0:13066:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787560610.641934:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560611.672589:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560612.687038:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787560613.345819:0:13218:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787560613.363015:0:13218:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787560613.363109:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560613.363351:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560613.363360:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560613.363369:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560613.363394:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787560613.363400:0:13218:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787560613.363423:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787560613.363436:0:13218:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9b3920000 x1874392815589120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560614 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787560613.363443:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560613.363453:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560613.363458:0:13218:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d986a03100 x1874392815589632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560619 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787560613.363468:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dae00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:3.0:1787560613.363475:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560613.363484:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560613.363487:0:13218:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9b3923800 x1874392815589760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560620 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:3.0:1787560613.363499:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560613.363507:0:13218:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d986a00e00 x1874392815589888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560625 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787560613.363509:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560613.363512:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787560613.363514:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787560613.363529:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d98949b000 00000100:00100000:1.0:1787560613.363530:0:13218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1787560613.363536:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787560613.363539:0:13218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1787560613.363546:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21dae00/0xe34191b05673ef4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673ef53 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560613.363559:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560613.363561:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560613.363563:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787560613.363567:0:13218:0:(import.c:65:import_set_state_nolock()) ffff93d881850800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787560613.363625:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874392815589632:0@lo:400:kworker.0 00000100:00100000:2.0:1787560613.363660:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815589760:0@lo:400:kworker.0 00000100:00100000:3.0:1787560613.363718:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874392815590144:0@lo:39:umount.0 00000100:00100000:0.0:1787560613.363763:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815589888:0@lo:400:kworker.0 00000100:00100000:0.0:1787560613.363773:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815589120:0@lo:400:kworker.0 00000400:00000100:3.0:1787560613.363784:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392815590144 offset 0 length 224: 4 00010000:00010000:0.0:1787560613.711578:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560614.735668:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787560615.119029:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560615.119040:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787560615.759037:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560616.786491:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560617.807184:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560618.831598:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560619.855353:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560620.239205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560620.239216:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787560620.879249:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560621.903043:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560622.927406:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560623.630990:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560613/real 1787560613] req@ffff93d99840e300 x1874392815590144/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560623 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560623.631024:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d99840e300 x1874392815590144/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560623 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787560623.631043:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d881850800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787560623.631066:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874392815590144:0@lo:39:umount.0 00000100:00080000:1.0:1787560623.631221:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787560623.631226:0:13218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787560623.631231:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787560623.632057:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560623.632071:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560623.632079:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560623.632085:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560623.632109:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560623.632116:0:13218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560623.633362:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560623.633374:0:7629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560623.633385:0:7629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da800 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560623.633390:0:7629:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560623.633401:0:7629:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560623.633409:0:7629:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560623.633415:0:7629:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787560623.633419:0:7629:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1787560623.633433:0:7629:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d98949b000 00010000:00010000:0.0:1787560623.633437:0:7629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560623.633442:0:7629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c21da800/0xe34191b05673ef5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673ef61 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560623.633459:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560623.633460:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560623.633462:0:7629:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560623.635803:0:13218:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560623.635827:0:13218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560623.635835:0:13218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560623.635901:0:13218:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787560623.635908:0:13218:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1787560623.635915:0:13218:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787560623.635944:0:13218:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787560623.635948:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787560623.635953:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560623.635959:0:13218:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787560623.635964:0:13218:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93d8812a99b8) has no exports 00000020:00080000:1.0:1787560623.635991:0:13218:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff93d8812a99b8) has no exports 00000020:01000000:1.0:1787560623.637590:0:13218:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d9b380ed80 - data ffff93d881437000/ffff93d882cad800 00000020:01000000:1.0:1787560623.637714:0:13218:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff93d9872dd540 - data ffff93d9bfe71bd0/ffff93d8822aec00 00010000:00010000:3.0:1787560623.638890:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560623.638901:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560623.638914:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d980030800 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:3.0:1787560623.638919:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560623.638930:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560623.638938:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560623.638945:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787560623.638948:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787560623.638952:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787560623.638971:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d98949b000 00010000:00010000:3.0:1787560623.638994:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560623.639001:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d980030800/0xe34191b05673f183 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673f18a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560623.639019:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560623.639021:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560623.639023:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787560623.649612:0:13218:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787560623.695751:0:13218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ee42 00000020:00000080:2.0:1787560623.695762:0:13218:0:(genops.c:885:class_export_put()) final put ffff93d9b5673800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787560623.695782:0:13218:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d9bfc6d000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787560623.695799:0:13218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d9bfc6d000 2 00000020:01000004:2.0:1787560623.695802:0:13218:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff93d9bfc6d000 from lustre-OST0001 00000020:00000080:2.0:1787560623.696269:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560623.696280:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787560623.696284:0:13218:0:(genops.c:885:class_export_put()) final put ffff93d881256800/lustre-OST0001_UUID 00000020:00000080:2.0:1787560623.696287:0:13218:0:(genops.c:844:class_export_destroy()) destroying export ffff93d881256800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787560623.696294:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787560623.696398:0:13218:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ba37d386-11cd-48cd-b42f-22b3cfa8191f->MGS 00010000:00010000:2.0:1787560623.696414:0:13218:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9c2044a00/0xe34191b05673ed54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673ed5b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560623.696426:0:13218:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9c2044a00/0xe34191b05673ed54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673ed5b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560623.696433:0:13218:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787560623.696435:0:13218:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787560623.696439:0:13218:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787560623.696453:0:13218:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d98949b000 00010000:00010000:2.0:1787560623.696457:0:13218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9c2044a00/0xe34191b05673ed54 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673ed5b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560623.696472:0:13218:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9b4462a00/0xe34191b05673efa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe34191b05673efa7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560623.696478:0:13218:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4462a00/0xe34191b05673efa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe34191b05673efa7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560623.696483:0:13218:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787560623.696485:0:13218:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787560623.696486:0:13218:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787560623.696494:0:13218:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff93d98949b000 00010000:00010000:2.0:1787560623.696496:0:13218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9b4462a00/0xe34191b05673efa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe34191b05673efa7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787560623.696517:0:13218:0:(import.c:65:import_set_state_nolock()) ffff93d98949b000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787560623.696521:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787560623.696524:0:13218:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787560623.696525:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787560623.696530:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787560623.696541:0:13218:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff93d9b3922d80 x1874392815590016/t0(0) o250->MGC192.168.201.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787560624 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787560623.696601:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787560623.696605:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:0.0:1787560623.697056:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9b5673800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1787560623.705640:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ba37d386-11cd-48cd-b42f-22b3cfa8191f:3310:1874392815590016:0@lo:250:kworker.0 10000000:01000000:2.0:1787560623.705751:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787560623.705765:0:13218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ec35 00000020:00000080:2.0:1787560623.705775:0:13218:0:(genops.c:885:class_export_put()) final put ffff93d991f4d800/ba37d386-11cd-48cd-b42f-22b3cfa8191f 00000020:01000000:2.0:1787560623.705794:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.156@tcp (flags='') 00000020:00000080:2.0:1787560623.705812:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787560623.705820:0:13218:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.156@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787560623.705824:0:13218:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff93d9901ecd28) has no exports 00000020:00000080:0.0:1787560623.706024:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d991f4d800/ba37d386-11cd-48cd-b42f-22b3cfa8191f for MGC192.168.201.156@tcp 10000000:01000000:3.0:1787560623.706152:0:5836:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787560623.706292:0:13218:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.156@tcp: client import never connected 00000100:00080000:2.0:1787560623.706296:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787560623.706299:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787560623.706302:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787560623.706304:0:13218:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787560623.706350:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560623.706356:0:13218:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.156@tcp (uuid ba37d386-11cd-48cd-b42f-22b3cfa8191f) 00000020:01000000:2.0:1787560623.706362:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787560623.706366:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787560623.706369:0:13218:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787560623.706375:0:13218:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff93d881856000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787560623.706380:0:13218:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff93d882263370) has exports, disconnecting them 00000020:00080000:2.0:1787560623.706385:0:13218:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff93d881856000), last request at 1787560401 00000020:00000080:2.0:1787560623.706389:0:13218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ee6c 00000020:00080000:2.0:1787560623.706413:0:13218:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff93d881856000): rc 0 00000020:00000080:2.0:1787560623.706417:0:13218:0:(genops.c:885:class_export_put()) final put ffff93d881856000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787560623.707094:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d98949b000 for MGC192.168.201.156@tcp 00000020:00000080:0.0:1787560623.707103:0:37:0:(genops.c:885:class_export_put()) final put ffff93d98949c000/ba37d386-11cd-48cd-b42f-22b3cfa8191f 00000020:00000080:0.0:1787560623.707106:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d98949c000/ba37d386-11cd-48cd-b42f-22b3cfa8191f for MGC192.168.201.156@tcp 00000020:01000000:0.0:1787560623.707111:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.156@tcp (ba37d386-11cd-48cd-b42f-22b3cfa8191f) 00000020:00000080:0.0:1787560623.707344:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d881856000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787560623.718980:0:13218:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787560623.718989:0:13218:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560623.718993:0:13218:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787560623.719001:0:13218:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787560623.719087:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1787560623.719216:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93d881850800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787560623.719405:0:7629:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787560623.719536:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787560623.719681:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff93d9851f9200:5822] 1 exiting: rc = 0 00000100:00100000:0.0:1787560623.719740:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff93d9851f8e00:5821] 0 exiting: rc = 1 00000100:00100000:3.0:1787560623.719822:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720090:0:7630:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff93d99841ba00:7630] 3 exiting: rc = 0 00000100:00100000:0.0:1787560623.720355:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff93d986a3b600:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1787560623.720414:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93d986a3b000:5824] 1 exiting: rc = 0 00000100:00100000:0.0:1787560623.720465:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff93d99070f000:5825] 2 exiting: rc = 0 00000100:00100000:3.0:1787560623.720629:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720637:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720643:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720649:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720654:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720660:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720666:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720672:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720678:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720683:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720696:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720703:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720709:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720715:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720720:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720741:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720748:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720753:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720757:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720763:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720768:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720774:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720780:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720785:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720791:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720796:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720802:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720806:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720811:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720816:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720821:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720826:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720830:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720835:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720840:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720884:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720889:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720894:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720899:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720905:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720909:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720914:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720919:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720925:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720929:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720934:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720949:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720955:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720959:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720963:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720976:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720981:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720986:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720991:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.720997:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.721002:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.721007:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.721011:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.721016:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.721021:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.721027:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.721032:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.721036:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.721042:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787560623.722792:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560623.722807:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787560623.722813:0:13218:0:(genops.c:885:class_export_put()) final put ffff93d881857000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787560623.722818:0:13218:0:(genops.c:844:class_export_destroy()) destroying export ffff93d881857000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787560623.722824:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787560623.722918:0:13218:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d9bfc6d000 1 00000020:00000080:3.0:1787560623.722925:0:13218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xe34191b05673ee11 00000020:00000080:3.0:1787560623.722932:0:13218:0:(genops.c:885:class_export_put()) final put ffff93d9bfc6e800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787560623.722953:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787560623.722958:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560623.722963:0:13218:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787560623.722967:0:13218:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff93d9894fb370) has no exports 00000020:00000080:0.0:1787560623.723241:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff93d9bfc6e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787560623.745455:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560623.745471:0:13218:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787560623.745477:0:13218:0:(genops.c:885:class_export_put()) final put ffff93d989578000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787560623.745482:0:13218:0:(genops.c:844:class_export_destroy()) destroying export ffff93d989578000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787560623.745494:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787560623.745708:0:13218:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff93d98957d800 00000020:01000000:3.0:1787560623.745733:0:13218:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787560623.745747:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560623.745752:0:13218:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787560623.745757:0:13218:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff93d9901e99b8) has no exports 00000020:00000080:3.0:1787560623.745784:0:13218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560623.745790:0:13218:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787560623.745793:0:13218:0:(genops.c:885:class_export_put()) final put ffff93d986acb000/OSS_uuid 00000020:00000080:3.0:1787560623.745796:0:13218:0:(genops.c:844:class_export_destroy()) destroying export ffff93d986acb000/OSS_uuid for OSS 00000020:01000000:3.0:1787560623.745799:0:13218:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787560623.745879:0:5834:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787560623.746032:0:8101:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff93d8813f3a00:8101] 3 exiting: rc = 0 00000100:00100000:3.0:1787560623.746077:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff93d995e68400:6684] 1 exiting: rc = 0 00000100:00100000:0.0:1787560623.752395:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff93d995e68600:6685] 2 exiting: rc = 0 00000100:00100000:0.0:1787560623.752497:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff93d9872a6e00:6683] 0 exiting: rc = 1 00000100:00100000:3.0:1787560623.752625:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752634:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752641:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752648:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752652:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752657:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752662:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752668:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752673:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752678:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752683:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752688:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752695:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752700:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752705:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752711:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752716:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752722:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752728:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752733:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752739:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752744:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752750:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752756:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752773:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752779:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752785:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752792:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752797:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752803:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752819:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752824:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752830:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752886:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752893:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752899:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752904:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752910:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752915:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752920:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752928:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752932:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752947:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752954:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752959:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752964:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752970:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752975:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752982:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752989:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.752995:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753000:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753005:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753010:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753015:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753020:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753024:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753029:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753034:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753047:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753053:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753058:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753063:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.753068:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.754900:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff93d995e68800:6687] 1 exiting: rc = 0 00000100:00100000:3.0:1787560623.755948:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff93d995e69400:6686] 0 exiting: rc = 1 00000100:00100000:0.0:1787560623.756147:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756156:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756160:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756165:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756171:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756175:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756180:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756184:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756189:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756207:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756212:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756217:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756223:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756228:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756233:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756238:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756244:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756249:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756254:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756259:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756265:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756269:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756274:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756291:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756309:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756315:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756320:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756325:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756330:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756335:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756340:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756344:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756349:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756354:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756359:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756364:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756369:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756375:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756380:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756384:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756390:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756395:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756400:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756405:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756416:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756421:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756426:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756430:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756435:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756439:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756444:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756449:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756454:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756458:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756462:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756467:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756472:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756477:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756482:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756486:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756490:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756495:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756499:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.756509:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.757705:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93d995e69e00:6690] 2 exiting: rc = 0 00000100:00100000:3.0:1787560623.758066:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff93d995e69a00:6688] 0 exiting: rc = 1 00000100:00100000:1.0:1787560623.758803:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff93d995e69200:6689] 1 exiting: rc = 0 00000100:00100000:0.0:1787560623.759207:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759216:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759222:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759228:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759234:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759239:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759244:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759250:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759258:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759264:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759269:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759274:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759408:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759416:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759422:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759440:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759445:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759471:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759478:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759485:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759491:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759496:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759502:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759507:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759513:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759519:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759526:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759530:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759536:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759542:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759547:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759553:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759558:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759646:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759654:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759660:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759666:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759671:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759676:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759682:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759687:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759709:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759716:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759722:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759729:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759735:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759741:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759747:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759753:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759759:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759772:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759778:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759784:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759790:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759796:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759804:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759810:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759816:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759821:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759827:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759832:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759895:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759902:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.759908:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.766783:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff93d986b1ba00:6691] 0 exiting: rc = 1 00000100:00100000:0.0:1787560623.767272:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff93d986b1b800:6692] 1 exiting: rc = 0 00000100:00100000:0.0:1787560623.767347:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767354:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767360:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767365:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767370:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767375:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767381:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767385:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767390:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767394:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767400:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767405:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767410:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767415:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767421:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767426:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767430:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767435:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767440:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767446:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767464:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767469:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767475:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767480:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767485:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767490:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767496:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767502:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767507:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767513:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767521:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767526:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767532:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767538:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767543:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767549:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767554:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767560:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767577:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767583:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767588:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767592:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767598:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767602:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767607:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767612:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767618:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767623:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767628:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767633:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767638:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767643:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767649:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767654:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767659:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767673:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767678:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767693:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767700:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767705:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767711:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767717:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767722:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.767727:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560623.769460:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93d995e61600:6693] 0 exiting: rc = 1 00000100:00100000:1.0:1787560623.769803:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff93d9b10a3200:6694] 1 exiting: rc = 0 00000100:00100000:3.0:1787560623.769989:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.769997:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770003:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770010:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770016:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770023:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770030:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770037:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770043:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770051:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770071:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770079:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770086:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770092:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770098:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770104:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770109:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770274:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770293:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770299:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770305:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770310:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770331:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770338:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770343:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770359:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770365:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770372:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770377:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770382:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770387:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770392:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770398:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770404:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770425:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770432:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770439:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770444:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770451:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770456:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770463:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770469:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770476:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770482:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770490:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770496:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770518:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770524:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770530:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770560:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770574:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770580:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770585:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770590:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770596:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770602:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770607:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770613:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770632:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770638:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770650:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770657:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770665:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560623.770672:0:13218:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787560623.789467:0:13218:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787560643.327213:0:13832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787560652.396034:0:14292:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787560652.396039:0:14292:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787560652.396150:0:14292:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d9bad52800 00000020:01000004:1.0:1787560652.396165:0:14292:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1787560652.396173:0:14292:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787560652.396186:0:14292:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff93d9901819b8) 00000020:00000080:1.0:1787560652.396198:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787560652.409504:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787560652.411190:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1787560652.411588:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 425: rc = 0 00100000:10000000:1.0:1787560652.411675:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 425: rc = 0 00100000:10000000:1.0:1787560652.411768:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 425: rc = 0 00100000:10000000:1.0:1787560652.411876:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 425: rc = 0 00100000:10000000:1.0:1787560652.412043:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787560652.412109:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 425: rc = 0 00100000:10000000:1.0:1787560652.412201:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 425: rc = 0 00100000:10000000:1.0:1787560652.412516:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 427: rc = 0 00100000:10000000:1.0:1787560652.413637:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 432: rc = 0 00100000:10000000:1.0:1787560652.413732:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 432: rc = 0 00100000:10000000:1.0:1787560652.414292:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 301: rc = 0 00100000:10000000:1.0:1787560652.414632:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 301: rc = 0 00100000:10000000:1.0:1787560652.415149:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 301: rc = 0 00100000:10000000:1.0:1787560652.415486:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 301: rc = 0 00100000:10000000:1.0:1787560652.415736:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 301: rc = 0 00100000:10000000:1.0:1787560652.416001:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 301: rc = 0 00100000:10000000:1.0:1787560652.416257:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 301: rc = 0 00100000:10000000:1.0:1787560652.416583:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 301: rc = 0 00100000:10000000:1.0:1787560652.416821:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 301: rc = 0 00100000:10000000:1.0:1787560652.417104:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 301: rc = 0 00100000:10000000:1.0:1787560652.417356:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 301: rc = 0 00100000:10000000:0.0:1787560652.417942:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 301: rc = 0 00100000:10000000:0.0:1787560652.418460:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 459: rc = 0 00100000:10000000:0.0:1787560652.418700:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 459: rc = 0 00100000:10000000:0.0:1787560652.418961:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 459: rc = 0 00100000:10000000:0.0:1787560652.419191:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 459: rc = 0 00100000:10000000:0.0:1787560652.419519:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 459: rc = 0 00100000:10000000:0.0:1787560652.419758:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 459: rc = 0 00100000:10000000:0.0:1787560652.420080:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 459: rc = 0 00100000:10000000:0.0:1787560652.420326:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 459: rc = 0 00100000:10000000:0.0:1787560652.420645:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 459: rc = 0 00100000:10000000:0.0:1787560652.420979:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 459: rc = 0 00100000:10000000:0.0:1787560652.421218:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 459: rc = 0 00100000:10000000:0.0:1787560652.421544:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 459: rc = 0 00100000:10000000:0.0:1787560652.421780:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 459: rc = 0 00100000:10000000:0.0:1787560652.422109:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 459: rc = 0 00100000:10000000:0.0:1787560652.422365:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 459: rc = 0 00100000:10000000:0.0:1787560652.422693:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 459: rc = 0 00100000:10000000:0.0:1787560652.423023:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 459: rc = 0 00100000:10000000:0.0:1787560652.423277:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 459: rc = 0 00100000:10000000:0.0:1787560652.423607:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 459: rc = 0 00100000:10000000:0.0:1787560652.423931:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 459: rc = 0 00100000:10000000:0.0:1787560652.424264:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 459: rc = 0 00100000:10000000:0.0:1787560652.424551:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 459: rc = 0 00100000:10000000:0.0:1787560652.424798:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 459: rc = 0 00100000:10000000:0.0:1787560652.425210:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 459: rc = 0 00100000:10000000:0.0:1787560652.425486:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 459: rc = 0 00100000:10000000:0.0:1787560652.425743:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 459: rc = 0 00100000:10000000:1.0:1787560652.427070:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 459: rc = 0 00100000:10000000:1.0:1787560652.427335:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 459: rc = 0 00100000:10000000:1.0:1787560652.427665:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 459: rc = 0 00100000:10000000:1.0:1787560652.428029:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 459: rc = 0 00100000:10000000:1.0:1787560652.428277:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 459: rc = 0 00100000:10000000:1.0:1787560652.428603:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 459: rc = 0 00100000:10000000:1.0:1787560652.428979:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 449: rc = 0 00100000:10000000:1.0:1787560652.429538:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787560652.429706:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 759: rc = 0 00100000:10000000:1.0:1787560652.429999:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787560652.430076:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 759: rc = 0 00100000:10000000:1.0:1787560652.430260:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787560652.430332:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 759: rc = 0 00100000:10000000:1.0:1787560652.430755:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787560652.430823:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 433: rc = 0 00100000:10000000:1.0:1787560652.431091:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787560652.431159:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 433: rc = 0 00100000:10000000:1.0:1787560652.431343:0:14292:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787560652.431496:0:14292:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 433: rc = 0 00000020:00000080:1.0:1787560652.431751:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787560652.431759:0:14292:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787560652.431769:0:14292:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ff36 00000020:01000004:1.0:1787560652.431778:0:14292:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787560652.431782:0:14292:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787560652.431788:0:14292:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d9bad52800 from MGS 00000020:01000004:1.0:1787560652.431792:0:14292:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787560652.431801:0:14292:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff93d990183370) 00000020:00000080:1.0:1787560652.431812:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787560652.431965:0:14292:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d9bad52800 from MGS, refs=2 00080000:01000000:1.0:1787560652.431971:0:14292:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787560652.431977:0:14292:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ff44 00000100:00100000:1.0:1787560652.432074:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787560652.432205:0:14292:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787560652.432211:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787560652.432718:0:14292:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787560652.432724:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787560652.433372:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560652.433538:0:14292:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787560652.433542:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787560652.434052:0:14292:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787560652.434058:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787560652.434339:0:14292:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787560652.434345:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787560652.434889:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560652.434892:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560652.434894:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560652.435161:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560652.435163:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560652.435165:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560652.435728:0:14292:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787560652.443708:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787560652.447088:0:14292:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787560652.447107:0:14292:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787560652.447110:0:14292:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787560652.449287:0:14301:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787560652.450242:0:14292:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787560652.450377:0:14292:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787560652.451198:0:14292:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787560652.452174:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560652.453939:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787560652.453949:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787560652.457513:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787560652.457530:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787560652.463632:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787560652.463647:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787560652.464815:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787560652.464837:0:14292:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.156@tcp' 00000020:01000004:3.0:1787560652.464839:0:14292:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787560652.464897:0:14292:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.156@tcp (typ=mgc) 00000020:00000080:3.0:1787560652.464909:0:14292:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.156@tcp (ffff93d9894fb370) 00000020:00000080:3.0:1787560652.464927:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787560652.465000:0:14292:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d9bad55800@MGC192.168.201.156@tcp: add connection 192.168.201.156@tcp at head 00010000:00010000:3.0:1787560652.465152:0:14292:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.156@tcp-0 is initialized 00000040:01000000:3.0:1787560652.465157:0:14292:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787560652.465352:0:14306:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787560652.471338:0:14307:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787560652.471438:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.156@tcp (uuid 449b2653-031b-4a00-838c-f2377a91f8ff) 00000020:00000080:3.0:1787560652.471461:0:14292:0:(genops.c:1385:class_connect()) connect: client 449b2653-031b-4a00-838c-f2377a91f8ff, cookie 0xe34191b05673ff52 00000100:00080000:3.0:1787560652.471472:0:14292:0:(import.c:510:import_select_connection()) MGC192.168.201.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560652.471478:0:14292:0:(import.c:624:import_select_connection()) MGC192.168.201.156@tcp: import ffff93d9bad55800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1787560652.471521:0:14292:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9894c5c00 x1874392815590272/t0(0) o250->MGC192.168.201.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560652.471552:0:14292:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 449b2653-031b-4a00-838c-f2377a91f8ff->MGS 00000020:01000004:3.0:1787560652.471575:0:14292:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787560652.471581:0:14292:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787560652.471593:0:14292:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff93d9894fcd28) 00000020:00000080:3.0:1787560652.471606:0:14292:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787560652.474898:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:449b2653-031b-4a00-838c-f2377a91f8ff:3310:1874392815590272:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787560652.474979:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560652.475068:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815590272 00000100:00100000:2.0:1787560652.475077:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815590272 00000100:00100000:2.0:1787560652.475112:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560652.475120:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8822af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874392815590272:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787560652.475148:0:14302:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 449b2653-031b-4a00-838c-f2377a91f8ff@0@lo t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:2.0:1787560652.475173:0:14302:0:(genops.c:1385:class_connect()) connect: client 449b2653-031b-4a00-838c-f2377a91f8ff, cookie 0xe34191b05673ff60 00000100:00080000:2.0:1787560652.475311:0:14302:0:(import.c:65:import_set_state_nolock()) ffff93d9894cc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560652.475374:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8822af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+5:3310:x1874392815590272:12345-0@lo:250:mount.lustre.0 Request processed in 253us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560652.475382:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560652.475444:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787560652.475452:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.156@tcp: connect to target with instance 0 00000100:00080000:2.0:1787560652.475459:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787560652.475464:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787560652.475468:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9bad55800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787560652.475470:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787560652.475478:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787560652.475482:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:449b2653-031b-4a00-838c-f2377a91f8ff:3310:1874392815590272:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787560652.493676:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560652.494640:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787560652.494647:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787560652.500652:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787560652.500661:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787560652.507993:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787560652.508008:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787560652.510119:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560652.510459:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787560652.510466:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787560652.511200:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787560652.511207:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787560652.580272:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560652.580591:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787560652.580599:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787560652.582775:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787560652.582787:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787560652.583548:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560652.584568:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787560652.584576:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787560652.585091:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787560652.585099:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787560652.585711:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560652.585915:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787560652.585920:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787560652.586796:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787560652.586805:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787560652.587639:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560652.588456:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787560652.588461:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787560652.589467:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787560652.589476:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787560652.619380:0:14292:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560652.619639:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787560652.619649:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787560652.622316:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787560652.622331:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787560652.623556:0:14292:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787560652.623567:0:14292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787560652.624627:0:14292:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787560652.624652:0:14292:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787560652.624659:0:14292:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787560652.625165:0:14292:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787560652.625206:0:14292:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787560652.625211:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787560652.625216:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787560652.625217:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560652.625218:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560652.625219:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560652.625220:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560652.625222:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787560652.625223:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787560652.625225:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560652.625226:0:14292:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787560652.625228:0:14292:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787560652.625230:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787560652.625231:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787560652.625232:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560652.625233:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560652.625234:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560652.625235:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560652.625235:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787560652.625236:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787560652.625237:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560652.625238:0:14292:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787560652.625263:0:14292:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787560652.625284:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815590400:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787560652.625352:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.625499:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9834cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.625545:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815590400 00000100:00100000:1.0:1787560652.625553:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815590400 00000100:00100000:1.0:1787560652.625632:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560652.625643:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8822af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+5:14292:x1874392815590400:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560652.625694:0:14305:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787560652.625697:0:14305:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787560652.625700:0:14305:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787560652.626305:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787560652.627049:0:14305:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787560652.628342:0:14327:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787560652.628349:0:14327:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787560652.628352:0:14327:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787560652.628458:0:14327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787560652.628715:0:14305:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787560652.628725:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787560652.638125:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8822af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+5:14292:x1874392815590400:12345-0@lo:253:mount.lustre.0 Request processed in 12474us (12763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.638139:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560652.640235:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815590400:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787560652.640255:0:14292:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787560652.640259:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787560652.640261:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787560652.640262:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560652.640264:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560652.640265:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560652.640267:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560652.640268:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787560652.640270:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787560652.640271:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560652.640273:0:14292:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787560652.640297:0:14292:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d9bad52800 from lustre-MDT0000 10000000:01000000:3.0:1787560652.640331:0:14292:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787560652.640345:0:14292:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787560652.640350:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93d9894fb370 10000000:01000000:3.0:1787560652.640366:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560652.640374:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93d9894fb370 from 1 10000000:01000000:3.0:1787560652.640377:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787560652.640417:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.640427:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.640436:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.640456:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815590528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560652.640514:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.640599:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9834cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.642760:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815590528 00000100:00100000:1.0:1787560652.642775:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815590528 00000100:00100000:1.0:1787560652.642877:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560652.642887:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+5:14292:x1874392815590528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560652.642904:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560652.642926:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4260400/0xe34191b05673ff6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ff67 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.642953:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4260400/0xe34191b05673ff6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ff67 expref: 6 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.642965:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4260400/0xe34191b05673ff6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ff67 expref: 6 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.642974:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260400, rc 0) 00000100:00100000:1.0:1787560652.643047:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+6:14292:x1874392815590528:12345-0@lo:101:mount.lustre.0 Request processed in 162us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.643054:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560652.643147:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815590528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560652.643164:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff6e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.643175:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ff6e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.643237:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815590656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560652.643266:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.646346:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9834cce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560652.646394:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815590656 00000100:00100000:2.0:1787560652.646403:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815590656 00000100:00100000:2.0:1787560652.646452:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560652.646461:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+6:14292:x1874392815590656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560652.651984:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+6:14292:x1874392815590656:12345-0@lo:501:mount.lustre.0 Request processed in 5514us (8708us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560652.652003:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815590656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560652.652004:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:3.0:1787560652.652039:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787560652.652065:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff6e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.652076:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff6e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560652.652086:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d9bad52800 10000000:01000000:3.0:1787560652.652091:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787560652.652096:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff93d9bad52800 10000000:01000000:3.0:1787560652.652098:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787560652.652101:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff93d9bad52800 from 1 10000000:01000000:3.0:1787560652.652104:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787560652.652137:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eb400/0xe34191b05673ff75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.652145:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9812eb400/0xe34191b05673ff75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.652155:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9812eb400/0xe34191b05673ff75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.652173:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815590784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560652.652208:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.652242:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9834cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.652323:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815590784 00000100:00100000:1.0:1787560652.652330:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815590784 00000100:00100000:1.0:1787560652.652428:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560652.652437:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+6:14292:x1874392815590784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560652.652449:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560652.652462:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4260e00/0xe34191b05673ff7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ff75 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.652484:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4260e00/0xe34191b05673ff7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ff75 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.652495:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4260e00/0xe34191b05673ff7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ff75 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.652897:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260e00, rc 0) 00000100:00100000:1.0:1787560652.652935:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+7:14292:x1874392815590784:12345-0@lo:101:mount.lustre.0 Request processed in 498us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.652941:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560652.653018:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815590784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560652.653031:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9812eb400/0xe34191b05673ff75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff7c expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.653039:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9812eb400/0xe34191b05673ff75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ff7c expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560652.653058:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787560652.653067:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eb400/0xe34191b05673ff75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff7c expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.653074:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812eb400/0xe34191b05673ff75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff7c expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560652.653080:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787560652.653084:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560652.653088:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff93d9bad52800 10000000:01000000:3.0:1787560652.653091:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787560652.653094:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787560652.653096:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787560652.653111:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eb200/0xe34191b05673ff83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.653118:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9812eb200/0xe34191b05673ff83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.653126:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9812eb200/0xe34191b05673ff83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.653138:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815590912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560652.653164:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.653348:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9834cce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560652.653385:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815590912 00000100:00100000:2.0:1787560652.653391:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815590912 00000100:00100000:2.0:1787560652.653424:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560652.653431:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+7:14292:x1874392815590912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560652.653439:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560652.653450:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98a710600/0xe34191b05673ff8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05673ff83 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560652.653464:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98a710600/0xe34191b05673ff8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05673ff83 expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560652.653472:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98a710600/0xe34191b05673ff8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05673ff83 expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560652.653479:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710600, rc 0) 00000100:00100000:2.0:1787560652.653600:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+8:14292:x1874392815590912:12345-0@lo:101:mount.lustre.0 Request processed in 168us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560652.653606:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560652.653806:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815590912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560652.653819:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9812eb200/0xe34191b05673ff83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff8a expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.653836:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9812eb200/0xe34191b05673ff83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05673ff8a expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.653955:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815591040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560652.653984:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.654044:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9834cce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560652.654078:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815591040 00000100:00100000:2.0:1787560652.654082:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815591040 00000100:00100000:2.0:1787560652.654102:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560652.654108:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+8:14292:x1874392815591040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560652.654496:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+9:14292:x1874392815591040:12345-0@lo:501:mount.lustre.0 Request processed in 386us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560652.655026:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560652.655111:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815591040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560652.655144:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815591168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560652.655182:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.655262:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9834cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.655305:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815591168 00000100:00100000:1.0:1787560652.655310:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815591168 00000100:00100000:1.0:1787560652.655344:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560652.655352:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+9:14292:x1874392815591168:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560652.655920:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+9:14292:x1874392815591168:12345-0@lo:503:mount.lustre.0 Request processed in 566us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.655927:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560652.656035:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815591168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560652.656328:0:14328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14328:1874392815591296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560652.656376:0:14328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560652.656440:0:14328:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9886379c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560652.656477:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815591296 00000100:00100000:2.0:1787560652.656481:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815591296 00000100:00100000:2.0:1787560652.656579:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560652.656587:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+9:14328:x1874392815591296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560652.657164:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+9:14328:x1874392815591296:12345-0@lo:502:llog_process_th.0 Request processed in 576us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560652.657176:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560652.657241:0:14328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14328:1874392815591296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560652.657273:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560652.657284:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560652.657287:0:14328:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787560652.657292:0:14328:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787560652.657295:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560652.657308:0:14328:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff93d990180000) 00000020:00000080:1.0:1787560652.657325:0:14328:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787560652.657329:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787560652.657397:0:14328:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787560652.657405:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ff98 00000020:00000080:1.0:1787560652.657809:0:14328:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787560652.657815:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560652.657819:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560652.657821:0:14328:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787560652.657823:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560652.657827:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560652.657828:0:14328:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787560652.657831:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560652.657839:0:14328:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff93d990184d28) 00000020:00000080:1.0:1787560652.657966:0:14328:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787560652.657973:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787560652.657975:0:14328:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787560652.657977:0:14328:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787560652.657983:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787560652.658025:0:14328:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d9bad52800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787560652.658048:0:14328:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff93d9bd3d4d28) 00000020:00000080:1.0:1787560652.658057:0:14328:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787560652.658108:0:14328:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787560652.658115:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe34191b05673ffad 00000020:00000080:1.0:1787560652.658203:0:14328:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787560652.658209:0:14328:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787560652.658213:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe34191b05673ffb4 00080000:01000000:1.0:1787560652.658223:0:14328:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787560652.658227:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ffbb 00010000:00010000:0.0:1787560652.711748:0:14328:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787560652.712476:0:14328:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1787560652.712777:0:14328:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787560652.713624:0:14328:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff93d882264d28) 00000020:00000080:0.0:1787560652.713642:0:14328:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787560652.713707:0:14328:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787560652.713715:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ffc9 00000020:00000080:0.0:1787560652.714647:0:14328:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787560652.727323:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe34191b05673ffd0 00000020:00000080:2.0:1787560652.727661:0:14328:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787560652.727675:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560652.727681:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560652.727684:0:14328:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787560652.727687:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787560652.727690:0:14328:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787560652.727691:0:14328:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560652.727693:0:14328:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560652.727694:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787560652.727696:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560652.727698:0:14328:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787560652.727700:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560652.727705:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560652.727707:0:14328:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787560652.727711:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787560652.727744:0:14328:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787560652.727757:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560652.727761:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560652.727762:0:14328:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787560652.727765:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787560652.727768:0:14328:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787560652.727771:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560652.727772:0:14328:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787560652.727775:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787560652.727780:0:14328:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.156@tcp to nid 0x20000c0a8c99c (192.168.201.156@tcp) 00000020:01000000:2.0:1787560652.727812:0:14328:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787560652.727815:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560652.727828:0:14328:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93d8812a99b8) 00000020:00000080:2.0:1787560652.727844:0:14328:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787560652.727883:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787560652.727943:0:14328:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787560652.727947:0:14328:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787560652.727952:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673ffde 00010000:00080000:2.0:1787560652.727976:0:14328:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d988653000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.156@tcp at head 00010000:00010000:2.0:1787560652.728166:0:14328:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787560652.728812:0:14328:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787560652.728886:0:14328:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787560652.730045:0:14328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560652.730107:0:14328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787560652.730171:0:14328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787560652.730485:0:14332:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787560652.730490:0:14332:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787560652.731063:0:14328:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787560652.731074:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787560652.731103:0:14328:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787560652.731121:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe34191b05673ffe5 00000100:00080000:2.0:1787560652.731131:0:14328:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560652.731137:0:14328:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d988653000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1787560652.731171:0:14328:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986a03100 x1874392815591424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560652.731243:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815591424:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787560652.731293:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392815591424 offset 0 length 520: 4 00000100:00080000:2.0:1787560652.731365:0:14328:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787560652.731427:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560652.731432:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560652.731434:0:14328:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787560652.731437:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787560652.731439:0:14328:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1787560652.731440:0:14328:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560652.731453:0:14328:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560652.731454:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787560652.731457:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560652.731458:0:14328:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787560652.731461:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787560652.731465:0:14328:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787560652.731468:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560652.731469:0:14328:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787560652.731471:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787560652.731474:0:14328:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.156@tcp to nid 0x20000c0a8c99c (192.168.201.156@tcp) 00000020:01000000:2.0:1787560652.731700:0:14328:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787560652.731704:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560652.731717:0:14328:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff93d8812ab370) 00000020:00000080:2.0:1787560652.731730:0:14328:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787560652.731735:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787560652.731805:0:14328:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787560652.731811:0:14328:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787560652.731818:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe34191b05673fff3 00010000:00080000:2.0:1787560652.731840:0:14328:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d9ba32b800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.156@tcp at head 00010000:00010000:2.0:1787560652.732060:0:14328:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787560652.732212:0:14328:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787560652.732227:0:14328:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787560652.732767:0:14328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560652.732807:0:14328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787560652.733022:0:14328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787560652.733389:0:14334:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787560652.733392:0:14334:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787560652.733989:0:14328:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787560652.733997:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787560652.734019:0:14328:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787560652.734033:0:14328:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe34191b05673fffa 00000100:00080000:0.0:1787560652.734040:0:14328:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560652.734049:0:14328:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d9ba32b800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:0.0:1787560652.734083:0:14328:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9b3920000 x1874392815591552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560652.734143:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815591552:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787560652.734197:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392815591552 offset 0 length 520: 4 00000100:00080000:0.0:1787560652.734241:0:14328:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787560652.734282:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560652.734285:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560652.734286:0:14328:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787560652.734289:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560652.734291:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560652.734292:0:14328:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787560652.734294:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787560652.734295:0:14328:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787560652.734297:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560652.734298:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560652.734299:0:14328:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787560652.734301:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560652.734302:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560652.734303:0:14328:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787560652.734306:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787560652.734327:0:14328:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14328:1874392815591680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560652.734373:0:14328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560652.734388:0:14328:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d989472d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.734429:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815591680 00000100:00100000:1.0:1787560652.734438:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815591680 00000100:00100000:1.0:1787560652.734487:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560652.734497:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+9:14328:x1874392815591680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560652.734681:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+9:14328:x1874392815591680:12345-0@lo:502:llog_process_th.0 Request processed in 185us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.734687:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560652.734719:0:14328:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14328:1874392815591680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787560652.734742:0:14328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560652.734745:0:14328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560652.734745:0:14328:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787560652.734748:0:14328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787560652.735059:0:14292:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787560652.735075:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787560652.735093:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eb200/0xe34191b05673ff83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff8a expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.735103:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812eb200/0xe34191b05673ff83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff8a expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560652.735111:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d9bad52800 from 1 10000000:01000000:3.0:1787560652.735114:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787560652.735139:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.735149:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.735158:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.735169:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815591808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560652.735199:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.735221:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d985312840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.735238:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815591808 00000100:00100000:1.0:1787560652.735243:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815591808 00000100:00100000:1.0:1787560652.735266:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560652.735272:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+9:14292:x1874392815591808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560652.735279:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560652.735296:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4261600/0xe34191b056740008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b056740001 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.735312:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4261600/0xe34191b056740008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b056740001 expref: 10 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.735319:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4261600/0xe34191b056740008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b056740001 expref: 10 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.735327:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261600, rc 0) 00000100:00100000:1.0:1787560652.735369:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+10:14292:x1874392815591808:12345-0@lo:101:mount.lustre.0 Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.735376:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560652.735385:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815591808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560652.735397:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.735404:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.735962:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815591936:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787560652.735994:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.736021:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d985312840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.736032:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815591936 00000100:00100000:1.0:1787560652.736036:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815591936 00000100:00100000:1.0:1787560652.736061:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560652.736068:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+10:14292:x1874392815591936:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787560652.736082:0:14303:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787560652.736087:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787560652.736151:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+10:14292:x1874392815591936:12345-0@lo:256:mount.lustre.0 Request processed in 85us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.736157:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560652.736166:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815591936:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787560652.736711:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787560652.736763:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.736770:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560652.736819:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9bad52800 from 1 10000000:01000000:3.0:1787560652.736821:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787560652.736837:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.736842:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.737022:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.737032:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560652.737054:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.737074:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d985312840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.737093:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815592064 00000100:00100000:1.0:1787560652.737098:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815592064 00000100:00100000:1.0:1787560652.737128:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560652.737134:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+10:14292:x1874392815592064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560652.737142:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560652.737152:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4261c00/0xe34191b056740016 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05674000f expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.737164:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4261c00/0xe34191b056740016 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05674000f expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.737171:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4261c00/0xe34191b056740016 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05674000f expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.737176:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261c00, rc 0) 00000100:00100000:1.0:1787560652.737205:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+11:14292:x1874392815592064:12345-0@lo:101:mount.lustre.0 Request processed in 72us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.737210:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560652.737232:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560652.737242:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.737248:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.737280:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560652.737297:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.737313:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d985312840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.737373:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815592192 00000100:00100000:1.0:1787560652.737377:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815592192 00000100:00100000:1.0:1787560652.737409:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560652.737416:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+11:14292:x1874392815592192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560652.737707:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+11:14292:x1874392815592192:12345-0@lo:501:mount.lustre.0 Request processed in 292us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.737712:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787560652.737732:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560652.737754:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560652.737782:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.737796:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d985312840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.737818:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815592320 00000100:00100000:1.0:1787560652.737821:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815592320 00000100:00100000:1.0:1787560652.737840:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560652.737843:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+11:14292:x1874392815592320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560652.737969:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+11:14292:x1874392815592320:12345-0@lo:503:mount.lustre.0 Request processed in 124us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.737975:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787560652.737988:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560652.738254:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14336:1874392815592448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560652.738279:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560652.738316:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815592448 00000100:00100000:1.0:1787560652.738316:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba7a0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560652.738321:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815592448 00000100:00100000:2.0:1787560652.738361:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560652.738368:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+11:14336:x1874392815592448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560652.738520:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+11:14336:x1874392815592448:12345-0@lo:502:llog_process_th.0 Request processed in 151us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560652.738527:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787560652.738673:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14336:1874392815592448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560652.738689:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560652.738696:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560652.738697:0:14336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787560652.738702:0:14336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d9bad52800 00000020:00000080:1.0:1787560652.738703:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560652.738709:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560652.738710:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560652.738711:0:14336:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787560652.738713:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560652.738714:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560652.738715:0:14336:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787560652.738717:0:14336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d9bad52800 00000020:00000080:1.0:1787560652.738722:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560652.738762:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560652.738765:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560652.738766:0:14336:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787560652.738768:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560652.738770:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560652.738771:0:14336:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787560652.738773:0:14336:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d9bad52800 00000020:00000080:1.0:1787560652.738774:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787560652.738795:0:14336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14336:1874392815592576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560652.738829:0:14336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560652.738871:0:14336:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba7a0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560652.740419:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815592576 00000100:00100000:2.0:1787560652.740428:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815592576 00000100:00100000:2.0:1787560652.740475:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560652.740486:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+11:14336:x1874392815592576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560652.740779:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+11:14336:x1874392815592576:12345-0@lo:502:llog_process_th.0 Request processed in 295us (1947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560652.740787:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560652.740833:0:14336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14336:1874392815592576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787560652.740886:0:14336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560652.740894:0:14336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560652.740896:0:14336:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787560652.740902:0:14336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787560652.741681:0:14292:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787560652.741703:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787560652.741843:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.741881:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560652.741933:0:14292:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787560652.741936:0:14292:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d9bad52800 10000000:01000000:3.0:1787560652.741940:0:14292:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d9bad52800 10000000:01000000:3.0:1787560652.741944:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560652.741949:0:14292:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d9bad52800 from 1 10000000:01000000:3.0:1787560652.741952:0:14292:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787560652.741985:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812ea000/0xe34191b05674001d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.741994:0:14292:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9812ea000/0xe34191b05674001d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.742004:0:14292:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9812ea000/0xe34191b05674001d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.742024:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560652.742071:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.742111:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9853123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560652.742230:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815592704 00000100:00100000:2.0:1787560652.742236:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815592704 00000100:00100000:2.0:1787560652.742275:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560652.742283:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+11:14292:x1874392815592704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560652.742296:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560652.742308:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98a711e00/0xe34191b056740024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05674001d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560652.742333:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98a711e00/0xe34191b056740024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05674001d expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560652.742370:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98a711e00/0xe34191b056740024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05674001d expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560652.742379:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711e00, rc 0) 00000100:00100000:2.0:1787560652.742425:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+12:14292:x1874392815592704:12345-0@lo:101:mount.lustre.0 Request processed in 142us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560652.742432:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560652.742965:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560652.742981:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9812ea000/0xe34191b05674001d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740024 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.742990:0:14292:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9812ea000/0xe34191b05674001d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b056740024 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.743035:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560652.743064:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.743091:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9853123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.743102:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815592832 00000100:00100000:1.0:1787560652.743108:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815592832 00000100:00100000:1.0:1787560652.743138:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787560652.743144:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+12:14292:x1874392815592832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560652.743415:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+12:14292:x1874392815592832:12345-0@lo:501:mount.lustre.0 Request processed in 270us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.743423:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787560652.744714:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560652.744755:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560652.744802:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.744838:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9853123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.744880:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815592960 00000100:00100000:1.0:1787560652.744885:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815592960 00000100:00100000:1.0:1787560652.744957:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787560652.744964:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+12:14292:x1874392815592960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560652.745104:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+12:14292:x1874392815592960:12345-0@lo:503:mount.lustre.0 Request processed in 140us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.745112:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787560652.745211:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815592960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560652.747343:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14340:1874392815593088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560652.747427:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560652.747501:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98319e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787560652.747529:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815593088 00000100:00100000:3.0:1787560652.747534:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815593088 00000100:00100000:3.0:1787560652.747591:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787560652.747597:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+12:14340:x1874392815593088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560652.747841:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+12:14340:x1874392815593088:12345-0@lo:502:llog_process_th.0 Request processed in 243us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560652.747867:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787560652.748053:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14340:1874392815593088:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787560652.748111:0:14340:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787560652.748124:0:14340:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff93d9bd3d0000) 00000020:00000080:1.0:1787560652.748140:0:14340:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787560652.748203:0:14340:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d9bad52800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787560652.748206:0:14340:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d9bad52800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787560652.748208:0:14340:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d9bad52800 4 00010000:00080000:1.0:1787560652.748230:0:14340:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d9865b0800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.156@tcp at head 00010000:00010000:1.0:1787560652.751373:0:14340:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787560652.751549:0:14340:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787560652.751576:0:14340:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787560652.751586:0:14340:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe34191b056740032 00000100:00080000:1.0:1787560652.751594:0:14340:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787560652.751599:0:14340:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93d9865b0800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1787560652.752502:0:14340:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d99840f800 x1874392815593216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560652.752520:0:14340:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787560652.753156:0:14340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14340:1874392815593344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560652.753219:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560652.753247:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815593344 00000100:00100000:1.0:1787560652.753252:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815593344 00000100:00100000:1.0:1787560652.753282:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560652.753659:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+12:14340:x1874392815593344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560652.754469:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+12:14340:x1874392815593344:12345-0@lo:502:llog_process_th.0 Request processed in 1178us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.754477:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560652.754524:0:14340:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98319ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.754541:0:14340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:449b2653-031b-4a00-838c-f2377a91f8ff:14340:1874392815593344:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787560652.754564:0:14340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787560652.754652:0:14292:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787560652.754675:0:14292:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787560652.754693:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812ea000/0xe34191b05674001d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740024 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.754712:0:14292:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812ea000/0xe34191b05674001d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740024 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787560652.754757:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787560652.754759:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787560652.754760:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560652.754762:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560652.754763:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560652.754765:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560652.754766:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787560652.754768:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787560652.754770:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560652.754771:0:14292:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560652.754774:0:14292:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787560652.754777:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787560652.754778:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787560652.754779:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560652.754780:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560652.754782:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560652.754783:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560652.754784:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787560652.754786:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787560652.754787:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560652.754788:0:14292:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560652.754806:0:14292:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787560652.754819:0:14292:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815593472:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787560652.754870:0:14292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560652.754901:0:14292:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d989472d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560652.755016:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815593472 00000100:00100000:3.0:1787560652.755021:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815593472 00000100:00100000:3.0:1787560652.755084:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560652.755094:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+12:14292:x1874392815593472:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787560652.755121:0:14303:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787560652.755132:0:14303:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787560652.756602:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874392815593216:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787560652.756740:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.756976:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815593216 00000100:00100000:3.0:1787560652.756983:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815593216 00000100:00100000:3.0:1787560652.757014:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560652.757020:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874392815593216:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787560652.757023:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560652.757032:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787560652.757073:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874392815593216:12345-0@lo:38:llog_process_th.0 Request processed in 52us (333us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787560652.757080:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560652.757123:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560652.757130:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9865b0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560652.757133:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787560652.757136:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874392815593216:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1787560652.801972:0:14303:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787560652.802032:0:14303:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787560652.802779:0:14326:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787560652.802784:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787560652.802890:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.802910:0:14326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4261600/0xe34191b056740008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b056740001 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.802918:0:14326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.802959:0:14326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4261600/0xe34191b056740008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b056740001 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560652.802974:0:14326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9b4261600/0xe34191b056740008 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b056740001 expref: 12 pid: 14305 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560652.803007:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14326:1874392815593600:0@lo:104: 00000100:00100000:3.0:1787560652.803070:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560652.803161:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9853120c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560652.809548:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815593600 00000100:00100000:1.0:1787560652.809565:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815593600 00000100:00100000:1.0:1787560652.809633:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560652.809645:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:449b2653-031b-4a00-838c-f2377a91f8ff+3:14326:x1874392815593600:12345-0@lo:104: 00010000:00010000:1.0:1787560652.809680:0:14293:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.809786:0:14293:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787560652.809792:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:449b2653-031b-4a00-838c-f2377a91f8ff+3:14326:x1874392815593600:12345-0@lo:104: Request processed in 150us (6723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.809809:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787560652.809828:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560652.809834:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.809842:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eaa00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560652.809862:0:14299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.809871:0:14299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560652.809880:0:14299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560652.809886:0:14299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560652.809952:0:14299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.809959:0:14299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560652.809978:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.809984:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9812eaa00/0xe34191b056740001 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740008 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810007:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560652.810009:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560652.810011:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560652.810151:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14326:1874392815593600:0@lo:104: 00010000:00010000:0.0:1787560652.810173:0:14326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560652.810216:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560652.810229:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449b2653-031b-4a00-838c-f2377a91f8ff:3313:1874392815593728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560652.810269:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560652.810516:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815593728 00000100:00100000:1.0:1787560652.810522:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815593728 00010000:00010000:1.0:1787560652.810541:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4261600/0xe34191b056740008 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b056740001 expref: 13 pid: 14305 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560652.810573:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560652.810581:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:449b2653-031b-4a00-838c-f2377a91f8ff+13:3313:x1874392815593728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560652.810594:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560652.810600:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4261600/0xe34191b056740008 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b056740001 expref: 13 pid: 14305 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810612:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4261600/0xe34191b056740008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b056740001 expref: 13 pid: 14305 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810627:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4261600/0xe34191b056740008 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b056740001 expref: 13 pid: 14305 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810641:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810818:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787560652.810834:0:14295:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008049395s 00010000:00010000:1.0:1787560652.810839:0:14295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810884:0:14295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810892:0:14295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810899:0:14295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810905:0:14295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebe00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560652.810909:0:14295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810917:0:14295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810928:0:14295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560652.810937:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560652.810971:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:449b2653-031b-4a00-838c-f2377a91f8ff+12:3313:x1874392815593728:12345-0@lo:103:ldlm_bl.0 Request processed in 391us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560652.810978:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787560652.811044:0:14326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.811051:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560652.811058:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9812ebe00/0xe34191b056740039 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560652.811093:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449b2653-031b-4a00-838c-f2377a91f8ff:3313:1874392815593728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560652.812100:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+11:14292:x1874392815593472:12345-0@lo:253:mount.lustre.0 Request processed in 57004us (57226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560652.812113:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787560652.812176:0:14292:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14292:1874392815593472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787560652.812190:0:14292:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787560652.812193:0:14292:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787560652.812195:0:14292:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787560652.812196:0:14292:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560652.812197:0:14292:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560652.812198:0:14292:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560652.812199:0:14292:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560652.812201:0:14292:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787560652.812202:0:14292:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787560652.812205:0:14292:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560652.812206:0:14292:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787560652.812217:0:14292:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787560652.821162:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560652.821333:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787560652.822428:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560652.822590:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787560652.824272:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560652.824445:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787560652.829323:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560652.829503:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787560652.831239:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787560652.831439:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787560652.833467:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787560652.833795:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787560652.867128:0:14292:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787560652.867408:0:14292:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787560652.867447:0:14350:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787560652.867451:0:14350:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1787560652.867714:0:14351:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787560652.867780:0:14351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560652.870571:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787560652.870650:0:14351:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787560652.870655:0:14351:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1787560652.874563:0:14292:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787560652.875122:0:14292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787560652.875572:0:14292:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787560652.875582:0:14292:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787560652.876257:0:14292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560652.877620:0:14292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787560652.879341:0:14292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787560652.879416:0:14292:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787560652.881469:0:14292:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787560652.888415:0:14292:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787560652.918636:0:14292:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787560652.918904:0:14292:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb1f01c6f988 00100000:10000000:2.0:1787560652.918915:0:14292:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787560652.919931:0:14292:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787560652.919947:0:14292:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787560652.919962:0:14292:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787560652.919989:0:14292:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787560653.454986:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787560653.776549:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787560653.839171:0:14307:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787560653.839195:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d9bad52800 from 6 10000000:01000000:0.0:1787560653.839202:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787560653.839440:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.839453:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.839465:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560653.839487:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815593856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560653.839562:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560653.839630:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d989472540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560653.839875:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815593856 00000100:00100000:1.0:1787560653.839882:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815593856 00000100:00100000:1.0:1787560653.839930:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787560653.839936:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+11:14307:x1874392815593856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560653.839946:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560653.839957:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4261e00/0xe34191b056740047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b056740040 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.839973:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4261e00/0xe34191b056740047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b056740040 expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.839980:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4261e00/0xe34191b056740047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b056740040 expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560653.839992:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261e00, rc 0) 00000100:00100000:1.0:1787560653.840030:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+12:14307:x1874392815593856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560653.840035:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787560653.840139:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815593856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560653.840151:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.840158:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560653.840202:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815593984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787560653.840448:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560653.840520:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d989472540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560653.841741:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815593984 00000100:00100000:2.0:1787560653.841751:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815593984 00000100:00100000:2.0:1787560653.841921:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560653.841931:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+12:14307:x1874392815593984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787560653.841952:0:14303:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787560653.841975:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787560653.841978:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787560653.842083:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+12:14307:x1874392815593984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 154us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560653.842091:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787560653.842177:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815593984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787560653.842238:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787560653.842247:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560653.842266:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560654.488268:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787560654.804239:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787560655.508757:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560656.537893:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560657.552681:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560658.127044:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560658.127053:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560658.127055:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560658.127058:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560658.127102:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787560658.127106:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787560658.127110:0:37:0:(import.c:65:import_set_state_nolock()) ffff93d9865b0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560658.127123:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff93d9865b0800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1787560658.127147:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986a02300 x1874392815594240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560658.127197:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560658.127210:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:449b2653-031b-4a00-838c-f2377a91f8ff:3312:1874392815594112:0@lo:400:kworker.0 00000100:00100000:2.0:1787560658.127293:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560658.127348:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815594112 00000100:00100000:2.0:1787560658.127355:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815594112 00000100:00100000:2.0:1787560658.127393:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560658.127402:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+12:3312:x1874392815594112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560658.127463:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+12:3312:x1874392815594112:12345-0@lo:400:kworker.0 Request processed in 62us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560658.127485:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560658.127529:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:449b2653-031b-4a00-838c-f2377a91f8ff:3312:1874392815594112:0@lo:400:kworker.0 00000100:00100000:3.0:1787560658.128006:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874392815594240:0@lo:38:kworker.0 00000100:00100000:3.0:1787560658.128041:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560658.129013:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815594240 00000100:00100000:3.0:1787560658.129029:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815594240 00000100:00100000:3.0:1787560658.129789:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560658.129799:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874392815594240:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787560658.129825:0:14312:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1787560658.129908:0:14312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe34191b05674004e 00000004:00100000:3.0:1787560658.129925:0:14312:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787560658.130059:0:14312:0:(import.c:65:import_set_state_nolock()) ffff93d9955a3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560658.130151:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874392815594240:12345-0@lo:38:kworker.0 Request processed in 351us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560658.130158:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787560658.130199:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d986a02300 x1874392815594240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787560658.130215:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787560658.130222:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787560658.130227:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787560658.130230:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9865b0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787560658.130235:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874392815594240:0@lo:38:kworker.0 00000001:02000400:3.0:1787560658.482836:0:14594:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787560658.580445:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560659.610681:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560660.630208:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787560661.580153:0:14744:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd43d502b0 20000000:00000080:1.0:1787560661.580172:0:14744:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d8813f4000 uarg=0000000000000000 20000000:01000000:1.0:1787560661.583959:0:14744:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787560661.583970:0:14744:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787560661.583976:0:14744:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787560661.589270:0:14745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787560661.590690:0:14744:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787560661.607193:0:14744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787560661.609511:0:14744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.609538:0:14744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4261c00/0xe34191b056740016 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05674000f expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.609547:0:14744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.609592:0:14744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4261c00/0xe34191b056740016 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05674000f expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560661.609621:0:14744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9b4261c00/0xe34191b056740016 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05674000f expref: 11 pid: 14305 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560661.609636:0:14744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14744:1874392815594368:0@lo:104: 00000100:00100000:0.0:1787560661.609705:0:14744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560661.609769:0:14744:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d989472c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560661.609902:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815594368 00000100:00100000:3.0:1787560661.609910:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815594368 00000100:00100000:3.0:1787560661.609948:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560661.609957:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:449b2653-031b-4a00-838c-f2377a91f8ff+3:14744:x1874392815594368:12345-0@lo:104: 00010000:00010000:3.0:1787560661.609970:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560661.610037:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560661.610043:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:449b2653-031b-4a00-838c-f2377a91f8ff+3:14744:x1874392815594368:12345-0@lo:104: Request processed in 87us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560661.610050:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787560661.610128:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560661.610136:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610144:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eae00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560661.610149:0:14298:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610157:0:14298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560661.610164:0:14298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560661.610169:0:14298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787560661.610218:0:14298:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610225:0:14298:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560661.610245:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610251:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9812eae00/0xe34191b05674000f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740016 expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610274:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560661.610291:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560661.610293:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560661.610305:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:449b2653-031b-4a00-838c-f2377a91f8ff:3312:1874392815594496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560661.610336:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560661.610398:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815594496 00000100:00100000:2.0:1787560661.610403:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815594496 00010000:00010000:2.0:1787560661.610421:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4261c00/0xe34191b056740016 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05674000f expref: 12 pid: 14305 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560661.610443:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560661.610449:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:449b2653-031b-4a00-838c-f2377a91f8ff+12:3312:x1874392815594496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560661.610460:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560661.610464:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4261c00/0xe34191b056740016 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05674000f expref: 12 pid: 14305 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610474:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4261c00/0xe34191b056740016 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05674000f expref: 12 pid: 14305 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610488:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610495:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610508:0:14296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610515:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610520:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610533:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610538:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100a00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560661.610542:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610548:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610557:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560661.610567:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560661.610594:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:449b2653-031b-4a00-838c-f2377a91f8ff+12:3312:x1874392815594496:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560661.610601:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560661.610636:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:449b2653-031b-4a00-838c-f2377a91f8ff:3312:1874392815594496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560661.611988:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4261c00/0xe34191b056740016 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05674000f expref: 11 pid: 14305 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560661.612005:0:14744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14744:1874392815594368:0@lo:104: 00010000:00010000:1.0:1787560661.612022:0:14744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560661.612033:0:14744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560661.612039:0:14744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560661.612047:0:14744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d990100a00/0xe34191b056740055 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560661.656311:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560662.224009:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560652/real 1787560652] req@ffff93d9b3920000 x1874392815591552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560662 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560662.224057:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d9b3920000 x1874392815591552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560662 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560662.224067:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560652/real 1787560652] req@ffff93d986a03100 x1874392815591424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560662 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560662.224078:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d986a03100 x1874392815591424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560662 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787560662.224094:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9ba32b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560662.224103:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787560662.224107:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815591552:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787560662.224112:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d988653000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560662.224117:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787560662.224120:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815591424:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787560662.224174:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560662.224178:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787560662.224180:0:37:0:(import.c:65:import_set_state_nolock()) ffff93d988653000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560662.224184:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 481 00000100:00080000:3.0:1787560662.224199:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787560662.224205:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d988653000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1787560662.224232:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9894c4a80 x1874392815594624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560662.224249:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560662.224253:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787560662.224259:0:37:0:(import.c:65:import_set_state_nolock()) ffff93d9ba32b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560662.224263:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 481 00000100:00080000:3.0:1787560662.224266:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787560662.224270:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d9ba32b800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1787560662.224281:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9894c5c00 x1874392815594752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560662.224357:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815594880:0@lo:400:kworker.0 00000100:00100000:2.0:1787560662.224415:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560662.224482:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815594880 00000100:00100000:1.0:1787560662.224490:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815594880 00000100:00100000:1.0:1787560662.224545:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560662.224548:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815594624:0@lo:8:kworker.0 00000100:00100000:1.0:1787560662.224557:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815594880:12345-0@lo:400:kworker.0 00000400:00000100:3.0:1787560662.224579:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392815594624 offset 0 length 520: 4 00000100:00100000:3.0:1787560662.224893:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815594752:0@lo:8:kworker.0 00000400:00000100:3.0:1787560662.224922:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392815594752 offset 0 length 520: 4 00000100:00100000:1.0:1787560662.226975:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815594880:12345-0@lo:400:kworker.0 Request processed in 2412us (2551us total) trans 0 rc 0/0 00010000:00080000:3.0:1787560662.226976:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d9894c4700 x1874392815594880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560662.226996:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560662.226999:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815594880:0@lo:400:kworker.0 00010000:00010000:0.0:1787560662.675818:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787560663.312360:0:14307:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560663.312367:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9bad52800 from 10 10000000:01000000:1.0:1787560663.312372:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560663.312421:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560663.312432:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560663.312443:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560663.312479:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815595008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560663.312553:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560663.312684:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787560663.319774:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815595008 00000100:00100000:3.0:1787560663.319790:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815595008 00000100:00100000:3.0:1787560663.319972:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787560663.319985:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+11:14307:x1874392815595008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560663.320005:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560663.320025:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9812ea200/0xe34191b056740063 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05674005c expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560663.320054:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9812ea200/0xe34191b056740063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05674005c expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560663.320066:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9812ea200/0xe34191b056740063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05674005c expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560663.320089:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea200, rc 0) 00000100:00100000:3.0:1787560663.320183:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+12:14307:x1874392815595008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (7616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560663.320191:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787560663.320707:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815595008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560663.320728:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560663.320738:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560663.320818:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815595136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560663.322048:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560663.322097:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987f3f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560663.322119:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815595136 00000100:00100000:3.0:1787560663.322126:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815595136 00000100:00100000:3.0:1787560663.322182:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787560663.322190:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+12:14307:x1874392815595136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560663.324164:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+12:14307:x1874392815595136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1967us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560663.324188:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560663.324573:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815595136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560663.324631:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815595264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560663.324689:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560663.324736:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787560663.325157:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815595264 00000100:00100000:3.0:1787560663.325165:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815595264 00000100:00100000:3.0:1787560663.325216:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787560663.325226:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+12:14307:x1874392815595264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560663.325438:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+12:14307:x1874392815595264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560663.325446:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787560663.325619:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815595264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787560663.326649:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787560663.329586:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787560663.329632:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560663.329644:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560663.329657:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560663.696112:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787560664.022478:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787560664.721601:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560665.743028:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560666.767618:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560667.351578:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560667.351586:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560667.351589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560667.351592:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787560667.351636:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449b2653-031b-4a00-838c-f2377a91f8ff:3314:1874392815595392:0@lo:400:kworker.0 00000100:00100000:2.0:1787560667.351702:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560667.351760:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815595520:0@lo:400:kworker.0 00000100:00100000:2.0:1787560667.351808:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560667.351878:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815595392 00000100:00100000:2.0:1787560667.351885:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815595392 00000100:00100000:2.0:1787560667.351927:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560667.351936:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+12:3314:x1874392815595392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560667.351979:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+12:3314:x1874392815595392:12345-0@lo:400:kworker.0 Request processed in 44us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.351986:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560667.352017:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815595520 00000100:00100000:2.0:1787560667.352020:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815595520 00000100:00100000:2.0:1787560667.352047:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560667.352054:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815595520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560667.352086:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815595520:12345-0@lo:400:kworker.0 Request processed in 33us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.352092:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787560667.352143:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d986a03b80 x1874392815595520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560667.352160:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815595520:0@lo:400:kworker.0 00000100:00100000:2.0:1787560667.352186:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449b2653-031b-4a00-838c-f2377a91f8ff:3314:1874392815595392:0@lo:400:kworker.0 00000020:01000004:0.0:1787560667.471795:0:14994:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787560667.471798:0:14994:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787560667.471965:0:14994:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d9bb20f000 00000020:01000004:0.0:1787560667.471981:0:14994:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787560667.471994:0:14994:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787560667.472009:0:14994:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff93d882260000) 00000020:00000080:0.0:1787560667.472032:0:14994:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787560667.494307:0:14994:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787560667.494676:0:14994:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787560667.495674:0:14994:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787560667.496156:0:14994:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787560667.496373:0:14994:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787560667.496927:0:14994:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 195: rc = 0 00100000:10000000:2.0:1787560667.497078:0:14994:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 195: rc = 0 00100000:10000000:2.0:1787560667.497220:0:14994:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 195: rc = 0 00100000:10000000:2.0:1787560667.498023:0:14994:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:2.0:1787560667.498283:0:14994:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:2.0:1787560667.498673:0:14994:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1787560667.499080:0:14994:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1787560667.499340:0:14994:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:2.0:1787560667.499666:0:14994:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00000020:00000080:2.0:1787560667.500557:0:14994:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787560667.500568:0:14994:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787560667.500579:0:14994:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe34191b056740071 00000020:01000004:2.0:1787560667.500587:0:14994:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787560667.500607:0:14994:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787560667.500610:0:14994:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787560667.500615:0:14994:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787560667.500620:0:14994:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787560667.500632:0:14994:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff93d8812acd28) 00000020:00000080:2.0:1787560667.500641:0:14994:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787560667.503283:0:14994:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560667.503665:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787560667.503671:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787560667.509499:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787560667.509513:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787560667.511192:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787560667.511202:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787560667.513378:0:14994:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560667.513620:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787560667.513625:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787560667.514285:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787560667.514292:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787560667.531073:0:14994:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560667.531321:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787560667.531327:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787560667.533106:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787560667.533119:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787560667.534038:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787560667.534047:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787560667.536712:0:14994:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560667.537179:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787560667.537186:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787560667.538713:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787560667.538724:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787560667.578137:0:14994:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560667.578609:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787560667.578617:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787560667.580305:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787560667.580317:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787560667.580812:0:14994:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787560667.580837:0:14994:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787560667.580843:0:14994:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787560667.591087:0:14994:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787560667.591149:0:14994:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.156@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787560667.591155:0:14994:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787560667.591157:0:14994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560667.591158:0:14994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560667.591159:0:14994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560667.591160:0:14994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560667.591161:0:14994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560667.591163:0:14994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560667.591164:0:14994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560667.591165:0:14994:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560667.591168:0:14994:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787560667.591171:0:14994:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560667.591172:0:14994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560667.591173:0:14994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560667.591174:0:14994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560667.591175:0:14994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560667.591176:0:14994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560667.591177:0:14994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560667.591178:0:14994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560667.591179:0:14994:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560667.591207:0:14994:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787560667.591230:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815595648:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787560667.591328:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560667.591405:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38faf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560667.591512:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815595648 00000100:00100000:1.0:1787560667.591521:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815595648 00000100:00100000:1.0:1787560667.591570:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787560667.591581:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+12:14994:x1874392815595648:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560667.591618:0:14302:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787560667.591621:0:14302:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787560667.591625:0:14302:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787560667.596324:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+12:14994:x1874392815595648:12345-0@lo:253:mount.lustre.0 Request processed in 4734us (4985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560667.596340:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560667.596576:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815595648:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787560667.596595:0:14994:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787560667.596598:0:14994:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560667.596600:0:14994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560667.596601:0:14994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560667.596602:0:14994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560667.596603:0:14994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560667.596605:0:14994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560667.596606:0:14994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560667.596608:0:14994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560667.596609:0:14994:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787560667.596632:0:14994:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d9bb20f000 from lustre-OST0000 10000000:01000000:2.0:1787560667.596661:0:14994:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787560667.596676:0:14994:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787560667.596683:0:14994:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d9894fb370 local copy 00010000:00010000:2.0:1787560667.596694:0:14994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff6e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560667.596950:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815595776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560667.597003:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560667.597176:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9a59c16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560667.597359:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815595776 00000100:00100000:3.0:1787560667.597366:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815595776 00000100:00100000:3.0:1787560667.597423:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787560667.597433:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+12:14994:x1874392815595776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560667.597628:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+12:14994:x1874392815595776:12345-0@lo:501:mount.lustre.0 Request processed in 196us (624us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560667.597637:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560667.597812:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815595776:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787560667.597829:0:14994:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787560667.598129:0:14994:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787560667.598139:0:14994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff6e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.598149:0:14994:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff6e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560667.598177:0:14994:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d9bb20f000 10000000:01000000:0.0:1787560667.598187:0:14994:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787560667.598192:0:14994:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93d9894fb370 10000000:01000000:0.0:1787560667.598194:0:14994:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787560667.598198:0:14994:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93d9894fb370 from 1 10000000:01000000:0.0:1787560667.598201:0:14994:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787560667.598227:0:14994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d990100600/0xe34191b05674007f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.598236:0:14994:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d990100600/0xe34191b05674007f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.598246:0:14994:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d990100600/0xe34191b05674007f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560667.598260:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815595904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560667.598293:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560667.598327:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d985312840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560667.598404:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815595904 00000100:00100000:2.0:1787560667.598410:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815595904 00000100:00100000:2.0:1787560667.598434:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560667.598442:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+12:14994:x1874392815595904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560667.598451:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560667.598465:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98a711a00/0xe34191b056740086 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05674007f expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.598485:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98a711a00/0xe34191b056740086 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05674007f expref: 13 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.598495:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98a711a00/0xe34191b056740086 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05674007f expref: 13 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.598504:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711a00, rc 0) 00000100:00100000:2.0:1787560667.598541:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+13:14994:x1874392815595904:12345-0@lo:101:mount.lustre.0 Request processed in 101us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.598548:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787560667.598726:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815595904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560667.598739:0:14994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d990100600/0xe34191b05674007f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740086 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.598747:0:14994:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d990100600/0xe34191b05674007f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b056740086 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560667.598762:0:14994:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787560667.598777:0:14994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d990100600/0xe34191b05674007f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740086 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.598784:0:14994:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d990100600/0xe34191b05674007f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740086 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560667.598810:0:14994:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787560667.598814:0:14994:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787560667.598818:0:14994:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787560667.598821:0:14994:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787560667.598835:0:14994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d990100c00/0xe34191b05674008d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.598843:0:14994:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d990100c00/0xe34191b05674008d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.598873:0:14994:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d990100c00/0xe34191b05674008d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560667.598885:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560667.598910:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560667.598938:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d985312840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560667.599108:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815596032 00000100:00100000:2.0:1787560667.599113:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815596032 00000100:00100000:2.0:1787560667.599145:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787560667.599159:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+13:14994:x1874392815596032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560667.599166:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560667.599174:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98a710400/0xe34191b056740094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05674008d expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.599189:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98a710400/0xe34191b056740094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05674008d expref: 14 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.599198:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98a710400/0xe34191b056740094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05674008d expref: 14 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.599204:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710400, rc 0) 00000100:00100000:2.0:1787560667.599232:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+14:14994:x1874392815596032:12345-0@lo:101:mount.lustre.0 Request processed in 74us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.599239:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787560667.599433:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560667.599446:0:14994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d990100c00/0xe34191b05674008d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740094 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.599455:0:14994:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d990100c00/0xe34191b05674008d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b056740094 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787560667.600615:0:14994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787560667.602340:0:14994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560667.602745:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787560667.603410:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787560667.603468:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787560667.603540:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787560667.603578:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787560667.603612:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787560667.603683:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787560667.603692:0:14994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787560667.603782:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560667.603888:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560667.603934:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9853126c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560667.604184:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815596160 00000100:00100000:2.0:1787560667.604192:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815596160 00000100:00100000:2.0:1787560667.604241:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787560667.604251:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+14:14994:x1874392815596160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560667.604622:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+14:14994:x1874392815596160:12345-0@lo:501:mount.lustre.0 Request processed in 370us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.604630:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787560667.604837:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560667.604913:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560667.604955:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560667.604992:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98725e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560667.605230:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815596288 00000100:00100000:0.0:1787560667.605235:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815596288 00000100:00100000:0.0:1787560667.605272:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787560667.605280:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+14:14994:x1874392815596288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560667.605596:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+14:14994:x1874392815596288:12345-0@lo:503:mount.lustre.0 Request processed in 316us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560667.605603:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787560667.606013:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787560667.608109:0:14994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787560667.608196:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560667.608272:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560667.608379:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9853126c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560667.608575:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815596416 00000100:00100000:3.0:1787560667.608583:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815596416 00000100:00100000:3.0:1787560667.608666:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560667.608676:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+14:14994:x1874392815596416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560667.608951:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+14:14994:x1874392815596416:12345-0@lo:502:mount.lustre.0 Request processed in 275us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560667.608959:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787560667.609064:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787560667.609326:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787560667.609388:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787560667.609708:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787560667.609763:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787560667.609811:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787560667.609931:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787560667.610035:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787560667.610076:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787560667.610130:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787560667.610180:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787560667.610214:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787560667.610261:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787560667.610302:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560667.610583:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560667.610748:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560667.610998:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815596544 00000100:00100000:2.0:1787560667.611006:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815596544 00000100:00100000:2.0:1787560667.611045:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787560667.611053:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+14:14994:x1874392815596544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560667.611288:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+14:14994:x1874392815596544:12345-0@lo:502:mount.lustre.0 Request processed in 234us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.611304:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787560667.612756:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787560667.612941:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787560667.612957:0:14994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787560667.614239:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787560667.614250:0:15008:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787560667.614257:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560667.614259:0:15008:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787560667.614265:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560667.614283:0:15008:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff93d8812a8000) 00000020:00000080:2.0:1787560667.614307:0:15008:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787560667.614313:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787560667.614491:0:15008:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d9bb20f000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787560667.614498:0:15008:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787560667.614507:0:15008:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe34191b0567400a2 00010000:00010000:2.0:1787560667.620297:0:15008:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787560667.621252:0:15008:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787560667.623795:0:15008:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787560667.625761:0:15008:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787560667.625774:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560667.625780:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560667.625782:0:15008:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787560667.625786:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787560667.625800:0:15008:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787560667.625806:0:15008:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560667.625809:0:15008:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560667.625810:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787560667.625813:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560667.625815:0:15008:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787560667.625817:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560667.625821:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560667.625823:0:15008:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787560667.625826:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787560667.625828:0:15008:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787560667.625830:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560667.625833:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560667.625834:0:15008:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787560667.625837:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560667.625838:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560667.625840:0:15008:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787560667.625843:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787560667.625929:0:15008:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560667.625933:0:15008:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560667.625935:0:15008:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787560667.625938:0:15008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787560667.626297:0:14994:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787560667.626336:0:14994:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787560667.626364:0:14994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d990100c00/0xe34191b05674008d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740094 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.626376:0:14994:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d990100c00/0xe34191b05674008d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740094 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560667.626384:0:14994:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9bb20f000 from 1 10000000:01000000:1.0:1787560667.626387:0:14994:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560667.626496:0:14994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.626504:0:14994:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.626516:0:14994:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560667.626542:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787560667.626609:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560667.626656:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d991cb99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560667.626734:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815596672 00000100:00100000:2.0:1787560667.626741:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815596672 00000100:00100000:2.0:1787560667.626798:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787560667.626808:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+14:14994:x1874392815596672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560667.626821:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560667.626833:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98a711800/0xe34191b0567400b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b0567400a9 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.626887:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98a711800/0xe34191b0567400b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b0567400a9 expref: 15 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.626898:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98a711800/0xe34191b0567400b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b0567400a9 expref: 15 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.626906:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711800, rc 0) 00000100:00100000:2.0:1787560667.626944:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815596672:12345-0@lo:101:mount.lustre.0 Request processed in 137us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.626962:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787560667.627206:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560667.627220:0:14994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.627229:0:14994:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560667.628071:0:14994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787560667.628989:0:14994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560667.629285:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787560667.629324:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787560667.630483:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787560667.630505:0:14994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787560667.630599:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560667.630662:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560667.631604:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d991cb99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560667.634355:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815596800 00000100:00100000:3.0:1787560667.634369:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815596800 00000100:00100000:3.0:1787560667.634422:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787560667.634432:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815596800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560667.634729:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815596800:12345-0@lo:501:mount.lustre.0 Request processed in 297us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560667.634737:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787560667.634921:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560667.634969:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560667.635017:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560667.635051:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d991cb99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560667.635175:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815596928 00000100:00100000:2.0:1787560667.635180:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815596928 00000100:00100000:2.0:1787560667.635214:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787560667.635221:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815596928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560667.635353:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815596928:12345-0@lo:503:mount.lustre.0 Request processed in 132us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.635359:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787560667.635481:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815596928:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787560667.635975:0:14994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560667.636037:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560667.636075:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560667.636106:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560667.636228:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815597056 00000100:00100000:2.0:1787560667.636234:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815597056 00000100:00100000:2.0:1787560667.636267:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787560667.636274:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815597056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560667.636424:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815597056:12345-0@lo:502:mount.lustre.0 Request processed in 150us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.636432:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787560667.636697:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560667.636976:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787560667.637026:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787560667.637077:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787560667.637128:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787560667.637162:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787560667.637210:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787560667.637258:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787560667.637296:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787560667.637324:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560667.637666:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560667.637726:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560667.640176:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815597184 00000100:00100000:2.0:1787560667.640188:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815597184 00000100:00100000:2.0:1787560667.640241:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560667.640251:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815597184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560667.640498:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815597184:12345-0@lo:502:mount.lustre.0 Request processed in 248us (2832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.640506:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560667.640565:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560667.640710:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787560667.640725:0:14994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787560667.642636:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560667.642649:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560667.642652:0:15012:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787560667.642658:0:15012:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d9bb20f000 00000020:00000080:1.0:1787560667.642661:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560667.642667:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560667.642670:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560667.642671:0:15012:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787560667.642673:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560667.642675:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560667.642676:0:15012:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787560667.642680:0:15012:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d9bb20f000 00000020:00000080:1.0:1787560667.642682:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560667.642778:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560667.642782:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560667.642784:0:15012:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787560667.642786:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560667.642797:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560667.642798:0:15012:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787560667.642802:0:15012:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d9bb20f000 00000020:00000080:1.0:1787560667.642804:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560667.643969:0:15012:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560667.643976:0:15012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560667.643977:0:15012:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787560667.643981:0:15012:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787560667.650873:0:14994:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787560667.650917:0:14994:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560667.650943:0:14994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.650957:0:14994:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560667.651008:0:14994:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787560667.651012:0:14994:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d9bb20f000 10000000:01000000:2.0:1787560667.651015:0:14994:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d9bb20f000 10000000:01000000:2.0:1787560667.651019:0:14994:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560667.651024:0:14994:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d9bb20f000 from 1 10000000:01000000:2.0:1787560667.651027:0:14994:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560667.651060:0:14994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d98a711000/0xe34191b0567400b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.651069:0:14994:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d98a711000/0xe34191b0567400b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.651080:0:14994:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d98a711000/0xe34191b0567400b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560667.651111:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560667.651177:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560667.657562:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b4125840 going to sleep for 11 seconds 00000100:00100000:2.0:1787560667.657958:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815597312 00000100:00100000:2.0:1787560667.657969:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815597312 00000100:00100000:2.0:1787560667.658050:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560667.658059:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815597312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560667.658083:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560667.658110:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98a711c00/0xe34191b0567400be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b0567400b7 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.658135:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98a711c00/0xe34191b0567400be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b0567400b7 expref: 16 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.658146:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98a711c00/0xe34191b0567400be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b0567400b7 expref: 16 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.658155:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711c00, rc 0) 00000100:00100000:2.0:1787560667.658220:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+16:14994:x1874392815597312:12345-0@lo:101:mount.lustre.0 Request processed in 161us (7042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.658227:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560667.662745:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560667.662776:0:14994:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d98a711000/0xe34191b0567400b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567400be expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.664525:0:14994:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d98a711000/0xe34191b0567400b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b0567400be expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560667.668195:0:14994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787560667.668650:0:14994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560667.670063:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787560667.670151:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787560667.670190:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787560667.670251:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787560667.670304:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787560667.670369:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787560667.672775:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787560667.672974:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787560667.673052:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787560667.673101:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787560667.673138:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787560667.673186:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787560667.673221:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787560667.673255:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787560667.673302:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787560667.673341:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787560667.674956:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787560667.675125:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787560667.675165:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787560667.675200:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787560667.675263:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787560667.675299:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787560667.675334:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787560667.676525:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787560667.676598:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787560667.676633:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787560667.676689:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787560667.676723:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787560667.677569:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787560667.677582:0:14994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787560667.677689:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560667.677756:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560667.677815:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9835b06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560667.679524:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815597440 00000100:00100000:0.0:1787560667.679535:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815597440 00000100:00100000:0.0:1787560667.679594:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787560667.679606:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+16:14994:x1874392815597440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560667.679905:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+16:14994:x1874392815597440:12345-0@lo:501:mount.lustre.0 Request processed in 302us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560667.679913:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787560667.680991:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560667.681050:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560667.681116:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560667.681151:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560667.681470:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815597568 00000100:00100000:1.0:1787560667.681478:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815597568 00000100:00100000:1.0:1787560667.681524:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787560667.681541:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+16:14994:x1874392815597568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560667.681722:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+16:14994:x1874392815597568:12345-0@lo:503:mount.lustre.0 Request processed in 182us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560667.681731:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560667.683549:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597568:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787560667.686336:0:14994:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787560667.686594:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560667.686685:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560667.686779:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560667.687165:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815597696 00000100:00100000:1.0:1787560667.687174:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815597696 00000100:00100000:1.0:1787560667.687267:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787560667.687278:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+16:14994:x1874392815597696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560667.687716:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+16:14994:x1874392815597696:12345-0@lo:502:mount.lustre.0 Request processed in 439us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560667.687725:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787560667.688967:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560667.689253:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787560667.689311:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787560667.689344:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787560667.689640:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787560667.689672:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787560667.689717:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787560667.689766:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787560667.689792:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787560667.690639:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787560667.690676:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787560667.690708:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787560667.690756:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787560667.691017:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787560667.691059:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787560667.691143:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787560667.691179:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787560667.691211:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787560667.691258:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787560667.691295:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787560667.691328:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787560667.691528:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787560667.691571:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787560667.691606:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787560667.691675:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787560667.691708:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787560667.691736:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787560667.691777:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787560667.691812:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787560667.691842:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787560667.692171:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787560667.692224:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787560667.692255:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787560667.692289:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787560667.692338:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787560667.692512:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787560667.692573:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787560667.692613:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787560667.692646:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787560667.692688:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787560667.692728:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787560667.692778:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560667.693060:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560667.693167:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b4125840 going to sleep for 11 seconds 00000100:00100000:0.0:1787560667.693214:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815597824 00000100:00100000:0.0:1787560667.693222:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815597824 00000100:00100000:0.0:1787560667.693310:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560667.693320:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+16:14994:x1874392815597824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560667.693698:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+16:14994:x1874392815597824:12345-0@lo:502:mount.lustre.0 Request processed in 378us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560667.693707:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787560667.693999:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a03b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815597824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560667.694081:0:14994:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787560667.694103:0:14994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787560667.695308:0:15017:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787560667.695324:0:15017:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93d9bd3d19b8) 00000020:00000080:1.0:1787560667.695344:0:15017:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787560667.695539:0:15017:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d9bb20f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787560667.695544:0:15017:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d9bb20f000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787560667.695546:0:15017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d9bb20f000 3 00010000:00080000:1.0:1787560667.695576:0:15017:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d99859d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.156@tcp at head 00010000:00010000:1.0:1787560667.698608:0:15017:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787560667.698917:0:15017:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787560667.698954:0:15017:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787560667.698967:0:15017:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe34191b0567400cc 00000100:00080000:1.0:1787560667.698977:0:15017:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787560667.698983:0:15017:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff93d99859d800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:1.0:1787560667.699018:0:15017:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d99840d500 x1874392815597952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560667.699042:0:15017:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787560667.699173:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874392815597952:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787560667.699245:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560667.699369:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560667.699374:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560667.699383:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560667.699386:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787560667.699837:0:15017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787560667.700001:0:14994:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787560667.700030:0:14994:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787560667.700052:0:14994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d98a711000/0xe34191b0567400b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567400be expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.700064:0:14994:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d98a711000/0xe34191b0567400b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567400be expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787560667.700117:0:14994:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787560667.700120:0:14994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560667.700121:0:14994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560667.700122:0:14994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560667.700123:0:14994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560667.700124:0:14994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560667.700126:0:14994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560667.700128:0:14994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560667.700130:0:14994:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787560667.700134:0:14994:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787560667.700136:0:14994:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560667.700137:0:14994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787560667.700138:0:14994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560667.700139:0:14994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560667.700140:0:14994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560667.700147:0:14994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560667.700148:0:14994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560667.700149:0:14994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560667.700150:0:14994:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787560667.700169:0:14994:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787560667.700181:0:14994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815598080:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787560667.700229:0:14994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560667.700251:0:14994:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b4125300 going to sleep for 11 seconds 00000100:00100000:1.0:1787560667.700369:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815597952 00000100:00100000:1.0:1787560667.700377:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815597952 00000100:00100000:1.0:1787560667.700423:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560667.700431:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1874392815597952:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787560667.700452:0:14344:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:1.0:1787560667.700488:0:14344:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe34191b0567400d3 00000004:00100000:1.0:1787560667.700503:0:14344:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787560667.700533:0:14344:0:(import.c:65:import_set_state_nolock()) ffff93d882df9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560667.700588:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874392815597952:12345-0@lo:38:llog_process_th.0 Request processed in 156us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560667.700596:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560667.700617:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815598080 00000100:00100000:1.0:1787560667.700621:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815598080 00000100:00100000:1.0:1787560667.700647:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787560667.700653:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+16:14994:x1874392815598080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560667.700672:0:14303:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787560667.700685:0:14303:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787560667.701033:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93d99840d500 x1874392815597952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560667.701044:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560667.701052:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787560667.701059:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787560667.701064:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787560667.701066:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d99859d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787560667.701071:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874392815597952:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1787560667.746571:0:14303:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787560667.746584:0:14303:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787560667.748474:0:14326:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787560667.748485:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787560667.748509:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.748526:0:14326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9b4261e00/0xe34191b056740047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b056740040 expref: 16 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.748534:0:14326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.748576:0:14326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9b4261e00/0xe34191b056740047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b056740040 expref: 16 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.748591:0:14326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9b4261e00/0xe34191b056740047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b056740040 expref: 16 pid: 14302 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560667.748606:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3920a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14326:1874392815598208:0@lo:104: 00000100:00100000:0.0:1787560667.748666:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560667.748715:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560667.752678:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815598208 00000100:00100000:2.0:1787560667.752695:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815598208 00000100:00100000:2.0:1787560667.752769:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560667.752783:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:449b2653-031b-4a00-838c-f2377a91f8ff+3:14326:x1874392815598208:12345-0@lo:104: 00010000:00010000:2.0:1787560667.752802:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560667.752954:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560667.752960:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:449b2653-031b-4a00-838c-f2377a91f8ff+3:14326:x1874392815598208:12345-0@lo:104: Request processed in 181us (4294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560667.752967:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787560667.753206:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3920a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14326:1874392815598208:0@lo:104: 00010000:00010000:0.0:1787560667.753232:0:14326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.753291:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560667.753304:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.753312:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101a00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:1.0:1787560667.753316:0:14299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.753325:0:14299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560667.753332:0:14299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560667.753339:0:14299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560667.753537:0:14299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.753545:0:14299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560667.753581:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.753588:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d990101a00/0xe34191b056740040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740047 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.753611:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560667.753613:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560667.753614:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560667.753652:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560667.753664:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449b2653-031b-4a00-838c-f2377a91f8ff:3311:1874392815598336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560667.753712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560667.753922:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815598336 00000100:00100000:1.0:1787560667.753928:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815598336 00010000:00010000:1.0:1787560667.753951:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9b4261e00/0xe34191b056740047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b056740040 expref: 17 pid: 14302 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560667.753991:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560667.754000:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449b2653-031b-4a00-838c-f2377a91f8ff+17:3311:x1874392815598336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560667.754011:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560667.754017:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9b4261e00/0xe34191b056740047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b056740040 expref: 17 pid: 14302 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754027:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9b4261e00/0xe34191b056740047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b056740040 expref: 17 pid: 14302 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754042:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4261e00/0xe34191b056740047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b056740040 expref: 17 pid: 14302 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754055:0:14297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754062:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787560667.754077:0:14297:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008049395s 00010000:00010000:1.0:1787560667.754082:0:14297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754098:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754105:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754112:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754125:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101e00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560667.754129:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754137:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754149:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560667.754158:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560667.754189:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449b2653-031b-4a00-838c-f2377a91f8ff+16:3311:x1874392815598336:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560667.754196:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787560667.754253:0:14326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.754262:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560667.754269:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d990101e00/0xe34191b0567400da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560667.754298:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449b2653-031b-4a00-838c-f2377a91f8ff:3311:1874392815598336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560667.770175:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+15:14994:x1874392815598080:12345-0@lo:253:mount.lustre.0 Request processed in 69511us (69934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560667.770192:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560667.770378:0:14994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:14994:1874392815598080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787560667.770519:0:14994:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787560667.770524:0:14994:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787560667.770526:0:14994:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787560667.770528:0:14994:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560667.770529:0:14994:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560667.770530:0:14994:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560667.770531:0:14994:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560667.770532:0:14994:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560667.770534:0:14994:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560667.770535:0:14994:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787560667.770550:0:14994:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787560667.778127:0:14994:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787560667.778490:0:14994:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787560667.778661:0:14994:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787560667.778916:0:14994:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787560667.779082:0:14994:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787560667.779280:0:14994:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787560667.780619:0:14994:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1787560667.794232:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787560667.859823:0:14994:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787560667.859831:0:14994:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787560667.859891:0:14994:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787560667.859956:0:14994:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787560667.859968:0:14994:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787560667.859999:0:14994:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787560668.815112:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787560669.209458:0:14307:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787560669.209465:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d9bad52800 from 7 10000000:01000000:3.0:1787560669.209470:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787560669.209512:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560669.209524:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560669.209535:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560669.209559:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815598464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560669.209624:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560669.209671:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9812ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560669.210912:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815598464 00000100:00100000:3.0:1787560669.210924:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815598464 00000100:00100000:3.0:1787560669.210993:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787560669.211004:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+15:14307:x1874392815598464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560669.211020:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560669.211037:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9812ebc00/0xe34191b0567400e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b0567400e1 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560669.211072:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9812ebc00/0xe34191b0567400e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b0567400e1 expref: 16 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560669.212424:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9812ebc00/0xe34191b0567400e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b0567400e1 expref: 16 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560669.212438:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ebc00, rc 0) 00000100:00100000:3.0:1787560669.212515:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+16:14307:x1874392815598464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1512us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560669.212523:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787560669.212594:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815598464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560669.212612:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560669.212621:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560669.212681:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815598592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787560669.212715:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560669.212752:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9812ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560669.227924:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815598592 00000100:00100000:0.0:1787560669.227943:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815598592 00000100:00100000:0.0:1787560669.228024:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787560669.228042:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+16:14307:x1874392815598592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787560669.228088:0:14303:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787560669.228107:0:14303:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787560669.228110:0:14303:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787560669.228250:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+16:14307:x1874392815598592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 211us (15534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560669.228259:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787560669.228328:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815598592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787560669.228401:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787560669.228410:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560669.228422:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560669.840893:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560670.864202:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560671.888911:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560672.915149:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560672.975501:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560672.975516:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560672.975519:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560672.975522:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787560672.975605:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815598848:0@lo:400:kworker.0 00000100:00100000:2.0:1787560672.975706:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560672.975881:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449b2653-031b-4a00-838c-f2377a91f8ff:3313:1874392815598720:0@lo:400:kworker.0 00000100:00100000:1.0:1787560672.976008:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560672.976073:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815598720 00000100:00100000:1.0:1787560672.976294:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815598720 00000100:00100000:1.0:1787560672.976353:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787560672.976366:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+16:3313:x1874392815598720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560672.976432:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+16:3313:x1874392815598720:12345-0@lo:400:kworker.0 Request processed in 68us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560672.976451:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787560672.976511:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449b2653-031b-4a00-838c-f2377a91f8ff:3313:1874392815598720:0@lo:400:kworker.0 00000100:00100000:2.0:1787560672.976686:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815598976:0@lo:400:kworker.0 00000100:00100000:2.0:1787560672.976723:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560672.978286:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815598848 00000100:00100000:2.0:1787560672.978300:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815598848 00000100:00100000:2.0:1787560672.978342:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815598976 00000100:00100000:2.0:1787560672.978346:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815598976 00000100:00100000:2.0:1787560672.978381:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560672.978392:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815598848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560672.978485:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874392815598848:12345-0@lo:400:kworker.0 Request processed in 95us (2779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560672.978492:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560672.978510:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560672.978516:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815598976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560672.978549:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815598976:12345-0@lo:400:kworker.0 Request processed in 33us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560672.978554:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787560672.978707:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787560672.978751:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d986a01500 x1874392815598976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560672.979356:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815598976:0@lo:400:kworker.0 00010000:00080000:2.0:1787560672.980108:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d986a01880 x1874392815598848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560672.980123:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874392815598848:0@lo:400:kworker.0 00010000:00010000:3.0:1787560673.938047:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560674.257488:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787560674.958955:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787560675.102345:0:15361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787560675.983351:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560677.007754:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560677.967321:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560662/real 1787560662] req@ffff93d9894c4a80 x1874392815594624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560677 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560677.967356:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d9894c4a80 x1874392815594624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560677 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560677.967369:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560662/real 1787560662] req@ffff93d9894c5c00 x1874392815594752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560677 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560677.967381:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93d9894c5c00 x1874392815594752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560677 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787560677.967400:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d988653000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560677.967416:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787560677.967420:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815594624:0@lo:8:kworker.0 00000100:00080000:2.0:1787560677.967426:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9ba32b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560677.967432:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787560677.967435:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815594752:0@lo:8:kworker.0 00000100:00080000:3.0:1787560677.968564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560677.968569:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787560677.968573:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d988653000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560677.968580:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:3.0:1787560677.968585:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787560677.968592:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff93d988653000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1787560677.968613:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9894c5500 x1874392815599232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560677.968629:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560677.968633:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787560677.968634:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d9ba32b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560677.968638:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 490 00000100:00080000:3.0:1787560677.968641:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787560677.968653:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d9ba32b800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1787560677.968665:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9894c7b80 x1874392815599360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560677.968708:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560677.968724:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449b2653-031b-4a00-838c-f2377a91f8ff:3311:1874392815599104:0@lo:400:kworker.0 00000100:00100000:3.0:1787560677.968801:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560677.968893:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815599488:0@lo:400:kworker.0 00000100:00100000:3.0:1787560677.968934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560677.968956:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560677.968962:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815599616:0@lo:400:kworker.0 00000100:00100000:3.0:1787560677.968988:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560677.969023:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815599104 00000100:00100000:3.0:1787560677.969030:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815599104 00000100:00100000:3.0:1787560677.969081:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560677.969092:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+16:3311:x1874392815599104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560677.969138:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+16:3311:x1874392815599104:12345-0@lo:400:kworker.0 Request processed in 47us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560677.969145:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560677.969380:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815599488 00000100:00100000:3.0:1787560677.969385:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815599488 00000100:00100000:3.0:1787560677.969420:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815599616 00000100:00100000:3.0:1787560677.969422:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815599616 00000100:00100000:3.0:1787560677.969454:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560677.969462:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815599488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560677.969500:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815599488:12345-0@lo:400:kworker.0 Request processed in 39us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560677.969506:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560677.969527:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560677.969534:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815599616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560677.969563:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815599616:12345-0@lo:400:kworker.0 Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560677.969570:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787560677.969592:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787560677.969622:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9894c5f80 x1874392815599616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560677.969635:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815599616:0@lo:400:kworker.0 00010000:00080000:3.0:1787560677.969646:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9894c4e00 x1874392815599488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560677.969654:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815599488:0@lo:400:kworker.0 00000100:00100000:3.0:1787560677.969679:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815599232:0@lo:8:kworker.0 00000100:00100000:3.0:1787560677.969707:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560677.969734:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815599360:0@lo:8:kworker.0 00000100:00100000:3.0:1787560677.969754:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560677.969785:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815599232 00000100:00100000:3.0:1787560677.969789:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815599232 00000100:00100000:3.0:1787560677.969803:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815599360 00000100:00100000:3.0:1787560677.969805:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815599360 00000100:00100000:3.0:1787560677.969814:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560677.969818:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874392815599232:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787560677.969841:0:14996:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1787560677.969887:0:14996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe34191b0567400ef 00002000:00100000:3.0:1787560677.969901:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff93d99859a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787560677.969921:0:14996:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787560677.969924:0:14996:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787560677.970231:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787560677.970252:0:14996:0:(import.c:65:import_set_state_nolock()) ffff93d99859d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560677.970291:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874392815599232:12345-0@lo:8:kworker.0 Request processed in 471us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560677.970298:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560677.970312:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560677.970316:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874392815599360:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787560677.970328:0:14996:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787560677.970352:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874392815599360:12345-0@lo:8:kworker.0 Request processed in 35us (597us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787560677.970358:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560677.970385:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449b2653-031b-4a00-838c-f2377a91f8ff:3311:1874392815599104:0@lo:400:kworker.0 00010000:00080000:3.0:1787560677.970411:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9894c5500 x1874392815599232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560677.970419:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560677.970426:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787560677.970433:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787560677.970439:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787560677.970441:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d988653000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787560677.970456:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787560677.970461:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815599232:0@lo:8:kworker.0 00000100:00080000:3.0:1787560677.970471:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9ba32b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560677.970475:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787560677.970485:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815599360:0@lo:8:kworker.0 00000004:00080000:1.0:1787560677.970867:0:14332:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787560677.971122:0:14332:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 506724274260ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787560677.975974:0:14333:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787560677.976001:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14333:1874392815599872:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787560677.976085:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560677.976112:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38faf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560677.978365:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560677.978393:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815599744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560677.978461:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560677.980754:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815599744 00000100:00100000:2.0:1787560677.980765:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815599744 00000100:00100000:2.0:1787560677.980810:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560677.980818:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874392815599744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560677.981114:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560677.981202:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874392815599744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 383us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560677.981210:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787560677.981236:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560677.982090:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815599872 00000100:00100000:3.0:1787560677.982100:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815599872 00000100:00100000:3.0:1787560677.982140:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560677.982149:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14333:x1874392815599872:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:1.0:1787560677.987778:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d986a01880 x1874392815599744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560677.987808:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815599744:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1787560677.988706:0:14996:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787560677.988719:0:14996:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787560677.988725:0:14996:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1787560677.996343:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560677.996356:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdfb64dc/0xe34191b0567400f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.996373:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560677.996377:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560677.996383:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfb64dc/0xe34191b0567400f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.996399:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdfb64dc/0xe34191b0567400f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.996410:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdfb64dc/0xe34191b0567400f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.996417:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfb64dc/0xe34191b0567400f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.996443:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560677.996584:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560677.996594:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdfb64dc/0xe34191b0567400f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.996605:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560677.996610:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdfb64dc/0xe34191b0567400f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.996620:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdfb64dc/0xe34191b0567400f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.996638:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdfb64dc/0xe34191b0567400f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.996646:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdfb64dc/0xe34191b0567400f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.996673:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560677.996675:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560677.996676:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560677.996900:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560677.996907:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4342d71/0xe34191b0567400fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.996926:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560677.996930:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560677.996935:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4342d71/0xe34191b0567400fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.996945:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4342d71/0xe34191b0567400fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.996954:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4342d71/0xe34191b0567400fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.996962:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4342d71/0xe34191b0567400fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.996984:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787560677.997333:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560677.997339:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edc749da/0xe34191b056740104 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.997346:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560677.997349:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560677.997352:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edc749da/0xe34191b056740104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.997370:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edc749da/0xe34191b056740104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.997378:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edc749da/0xe34191b056740104 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.997384:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edc749da/0xe34191b056740104 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.997403:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787560677.997430:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560677.997436:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4342d71/0xe34191b0567400fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997445:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb000 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560677.997449:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4342d71/0xe34191b0567400fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997458:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4342d71/0xe34191b0567400fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997471:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4342d71/0xe34191b0567400fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997479:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4342d71/0xe34191b0567400fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997499:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560677.997503:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edc749da/0xe34191b056740104 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997511:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560677.997515:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edc749da/0xe34191b056740104 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997522:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edc749da/0xe34191b056740104 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997545:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edc749da/0xe34191b056740104 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997553:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edc749da/0xe34191b056740104 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997574:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560677.997577:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560677.997580:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560677.997790:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560677.997796:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0dd1308/0xe34191b05674010b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.997804:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560677.997806:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560677.997810:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0dd1308/0xe34191b05674010b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.997819:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0dd1308/0xe34191b05674010b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.997826:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0dd1308/0xe34191b05674010b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.997844:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0dd1308/0xe34191b05674010b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560677.997879:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560677.997888:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560677.997894:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0dd1308/0xe34191b05674010b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997902:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea800 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560677.997907:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0dd1308/0xe34191b05674010b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997927:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0dd1308/0xe34191b05674010b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997939:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0dd1308/0xe34191b05674010b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560677.997941:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560677.997949:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0dd1308/0xe34191b05674010b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560677.997975:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560677.997977:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560677.997978:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.001570:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.001584:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fc4637b/0xe34191b056740112 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.001605:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.001610:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.001616:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fc4637b/0xe34191b056740112 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.001630:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fc4637b/0xe34191b056740112 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.001641:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fc4637b/0xe34191b056740112 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.001648:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fc4637b/0xe34191b056740112 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.001680:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.001700:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.001705:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fc4637b/0xe34191b056740112 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.001719:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb800 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.001724:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fc4637b/0xe34191b056740112 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.001732:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fc4637b/0xe34191b056740112 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.001749:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fc4637b/0xe34191b056740112 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.001755:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fc4637b/0xe34191b056740112 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.001778:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.001780:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.001781:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.002512:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.002519:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1b93a8e/0xe34191b056740119 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.002529:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.002532:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.002536:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b93a8e/0xe34191b056740119 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.002547:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1b93a8e/0xe34191b056740119 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.002561:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1b93a8e/0xe34191b056740119 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.002569:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b93a8e/0xe34191b056740119 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.002586:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.002596:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.002601:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1b93a8e/0xe34191b056740119 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.002608:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eae00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.002613:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1b93a8e/0xe34191b056740119 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.002622:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1b93a8e/0xe34191b056740119 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.002633:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1b93a8e/0xe34191b056740119 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.002640:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1b93a8e/0xe34191b056740119 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.002657:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.002664:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.002666:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.003541:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.003550:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b056740120 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.003563:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.003566:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.003572:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b056740120 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.003583:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b056740120 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.003591:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b056740120 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.003598:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b056740120 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.003766:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560678.004128:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560678.004136:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b056740120 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560678.004147:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebe00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560678.004151:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b056740120 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560678.004161:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b056740120 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560678.004178:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b056740120 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560678.004217:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea0318e/0xe34191b056740120 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560678.004698:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.004705:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd787f2/0xe34191b056740127 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.004714:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.004717:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.004722:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd787f2/0xe34191b056740127 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.004740:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cd787f2/0xe34191b056740127 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.004748:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cd787f2/0xe34191b056740127 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.004755:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cd787f2/0xe34191b056740127 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.004769:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.004778:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.004783:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cd787f2/0xe34191b056740127 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.004790:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eaa00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.004794:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd787f2/0xe34191b056740127 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.004802:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd787f2/0xe34191b056740127 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.004813:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cd787f2/0xe34191b056740127 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.004821:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd787f2/0xe34191b056740127 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.004844:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560678.004939:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560678.004941:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560678.004943:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.005290:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.005293:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.007636:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.007653:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b05674012e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.007670:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.007675:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.007681:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b05674012e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.007694:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b05674012e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.007704:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b05674012e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.007713:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b05674012e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.007735:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.007748:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.007753:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b05674012e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.007771:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044a00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.007776:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b05674012e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.007785:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b05674012e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.007800:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b05674012e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.007808:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b05674012e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.007827:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.007829:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.007831:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.008512:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.008519:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740135 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.008529:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.008532:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.008537:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.008546:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.008561:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.008568:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.008582:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.008590:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.008595:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.008601:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044e00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.008605:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.008613:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740135 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.008624:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740135 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.008630:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740135 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.008643:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.008648:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.008650:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.009440:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.009448:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674013c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.009459:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.009462:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.009467:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674013c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.009477:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674013c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.009485:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674013c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.009492:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674013c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.009508:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.009517:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.009521:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674013c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.009528:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.009532:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674013c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.009551:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674013c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.009563:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674013c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.009570:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674013c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.009583:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.009585:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.009587:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.011533:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.011543:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740143 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.011555:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.011559:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.011564:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740143 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.011576:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740143 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.011585:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740143 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.011599:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740143 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.011617:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.011628:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.011632:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740143 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.011639:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.011643:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740143 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.011652:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740143 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.011666:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740143 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.011672:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740143 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.011688:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.011689:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.011691:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.012423:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.012439:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674014a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.012451:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.012455:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.012459:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674014a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.012470:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674014a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.012478:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674014a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.012485:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674014a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.012502:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.012512:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.012516:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674014a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.012523:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044c00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.012526:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674014a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.012534:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674014a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.012551:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674014a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.012558:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674014a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.012572:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.012574:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.012575:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.014806:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.014819:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b056740151 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.014833:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.014837:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.014843:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b056740151 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.016016:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b056740151 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.016026:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b056740151 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.016033:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b056740151 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.016385:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787560678.017575:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560678.017587:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b056740151 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.017600:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2045e00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560678.017605:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b056740151 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.017616:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b056740151 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.017639:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b056740151 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.017648:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e9fb84b/0xe34191b056740151 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.017672:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560678.017674:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560678.017676:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.021899:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.021923:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740158 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.021942:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.021947:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.021954:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.021971:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.021982:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740158 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.021991:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022010:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787560678.022541:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.022548:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674015f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022557:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.022565:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.022570:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674015f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022581:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674015f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022589:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674015f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022596:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674015f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022615:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787560678.022626:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560678.022631:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022639:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044e00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.022644:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740158 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022653:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740158 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022668:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740158 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022685:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005e2b0bf/0xe34191b056740158 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022703:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.022706:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674015f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022712:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044c00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.022715:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674015f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022722:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674015f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022732:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674015f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022738:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a347fca/0xe34191b05674015f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.022748:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.022750:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.022752:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.023764:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.023774:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740166 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.023791:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.023795:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.023801:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.023814:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.023823:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740166 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.023831:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.023874:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.023886:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.023890:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.023898:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.023903:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740166 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.023926:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740166 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.023951:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740166 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.023959:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec0200c6/0xe34191b056740166 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.023976:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.023978:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.023980:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.024362:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.024368:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674016d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024376:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.024379:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.024384:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674016d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024394:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674016d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024402:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674016d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024409:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674016d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024435:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.024444:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.024447:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674016d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024453:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.024456:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674016d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024463:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674016d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024473:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674016d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024479:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d0f0b24/0xe34191b05674016d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024493:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.024495:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.024496:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.024890:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.024896:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b056740174 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.024905:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1787560678.025359:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787560678.026086:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787560678.029286:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.029296:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b056740174 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.029317:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b056740174 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.029330:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b056740174 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.029337:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b056740174 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.030527:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.030544:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.030552:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b056740174 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.030562:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044a00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.030567:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b056740174 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.030577:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b056740174 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.030596:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b056740174 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.030619:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dc30753/0xe34191b056740174 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.030644:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.030646:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.030649:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.034784:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.034803:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083dbc69c/0xe34191b05674017b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.034822:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.034826:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.034833:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083dbc69c/0xe34191b05674017b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.034862:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083dbc69c/0xe34191b05674017b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.034875:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083dbc69c/0xe34191b05674017b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.034884:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083dbc69c/0xe34191b05674017b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.034924:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.034943:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.034955:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083dbc69c/0xe34191b05674017b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.034963:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da800 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.034967:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083dbc69c/0xe34191b05674017b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.034976:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083dbc69c/0xe34191b05674017b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.034992:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083dbc69c/0xe34191b05674017b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035000:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083dbc69c/0xe34191b05674017b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035018:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.035021:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.035022:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.035496:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.035503:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db693135/0xe34191b056740182 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035513:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.035516:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.035521:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db693135/0xe34191b056740182 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035541:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db693135/0xe34191b056740182 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035549:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db693135/0xe34191b056740182 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035557:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db693135/0xe34191b056740182 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035575:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560678.035584:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560678.035590:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db693135/0xe34191b056740182 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035598:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dae00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560678.035602:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db693135/0xe34191b056740182 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035609:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db693135/0xe34191b056740182 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035620:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db693135/0xe34191b056740182 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035627:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db693135/0xe34191b056740182 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.035649:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.035651:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.035653:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560678.036288:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560678.036472:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.036479:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da58b28/0xe34191b056740189 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.036490:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.036493:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.036498:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da58b28/0xe34191b056740189 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.036508:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da58b28/0xe34191b056740189 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.036517:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da58b28/0xe34191b056740189 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.036524:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da58b28/0xe34191b056740189 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.036573:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787560678.037010:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.037017:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca65f3c1/0xe34191b056740190 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.037035:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.037039:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.037044:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca65f3c1/0xe34191b056740190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.037053:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca65f3c1/0xe34191b056740190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.037061:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca65f3c1/0xe34191b056740190 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.037068:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca65f3c1/0xe34191b056740190 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.041651:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560678.041665:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da58b28/0xe34191b056740189 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.041685:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dbc00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560678.041689:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da58b28/0xe34191b056740189 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.041700:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da58b28/0xe34191b056740189 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.041722:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da58b28/0xe34191b056740189 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.041729:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da58b28/0xe34191b056740189 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.041757:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560678.041762:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca65f3c1/0xe34191b056740190 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.041767:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560678.041770:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca65f3c1/0xe34191b056740190 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.041778:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca65f3c1/0xe34191b056740190 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.041786:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca65f3c1/0xe34191b056740190 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560678.041799:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560678.041800:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560678.041802:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560678.041874:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787560678.041881:0:14996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca65f3c1/0xe34191b056740190 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560678.042504:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.042512:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b50adf29/0xe34191b056740197 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.042524:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.042529:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.042536:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b50adf29/0xe34191b056740197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.042562:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b50adf29/0xe34191b056740197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.042571:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b50adf29/0xe34191b056740197 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.042579:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b50adf29/0xe34191b056740197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.042599:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787560678.043673:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.043682:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b34bc16/0xe34191b05674019e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.043694:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.043698:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.043703:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b34bc16/0xe34191b05674019e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.043714:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b34bc16/0xe34191b05674019e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.043723:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b34bc16/0xe34191b05674019e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.043742:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b34bc16/0xe34191b05674019e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.043752:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787560678.044192:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.044198:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081dec949/0xe34191b0567401a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.044207:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.044210:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.044215:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081dec949/0xe34191b0567401a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.044223:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081dec949/0xe34191b0567401a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.044231:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081dec949/0xe34191b0567401a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.044237:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081dec949/0xe34191b0567401a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.044245:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787560678.044617:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787560678.044623:0:14996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e3f902/0xe34191b0567401ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.044637:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787560678.044640:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560678.044644:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e3f902/0xe34191b0567401ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.044652:0:14996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5e3f902/0xe34191b0567401ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.044658:0:14996:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e3f902/0xe34191b0567401ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.044664:0:14996:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e3f902/0xe34191b0567401ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560678.044672:0:14996:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:3.0:1787560678.044827:0:14996:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:0.0:1787560678.046983:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787560678.046997:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b50adf29/0xe34191b056740197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047009:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560678.047014:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b50adf29/0xe34191b056740197 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047023:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b50adf29/0xe34191b056740197 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047045:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b50adf29/0xe34191b056740197 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047051:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b50adf29/0xe34191b056740197 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047082:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787560678.047086:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b34bc16/0xe34191b05674019e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047104:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21daa00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560678.047107:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b34bc16/0xe34191b05674019e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047114:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b34bc16/0xe34191b05674019e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047124:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b34bc16/0xe34191b05674019e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047133:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b34bc16/0xe34191b05674019e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047149:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560678.047152:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081dec949/0xe34191b0567401a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047158:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21da400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560678.047161:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081dec949/0xe34191b0567401a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047167:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081dec949/0xe34191b0567401a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047177:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081dec949/0xe34191b0567401a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047190:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081dec949/0xe34191b0567401a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047204:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560678.047207:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5e3f902/0xe34191b0567401ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047214:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db000 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560678.047217:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e3f902/0xe34191b0567401ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047224:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e3f902/0xe34191b0567401ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047234:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5e3f902/0xe34191b0567401ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047241:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5e3f902/0xe34191b0567401ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560678.047252:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560678.047253:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560678.047255:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560678.047348:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560678.054048:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14333:x1874392815599872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 71893us (77954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560678.054062:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560678.054187:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14333:1874392815599872:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787560678.054206:0:14333:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787560678.054256:0:14333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14333:1874392815600000:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787560678.054308:0:14333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560678.054357:0:14333:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9b38faf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560678.054411:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815600000 00000100:00100000:3.0:1787560678.054419:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815600000 00000100:00100000:3.0:1787560678.054463:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560678.054472:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14333:x1874392815600000:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787560678.054516:0:14998:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787560678.059385:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14333:x1874392815600000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4905us (5069us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787560678.059409:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560678.059594:0:14333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14333:1874392815600000:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787560678.059610:0:14333:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:3.0:1787560678.215424:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787560678.215480:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787560679.055511:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560680.079007:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560681.121056:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787560681.910125:0:15711:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787560681.910139:0:15711:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787560681.910273:0:15711:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff93d881854800 00000020:01000004:0.0:1787560681.910289:0:15711:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787560681.910303:0:15711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787560681.910317:0:15711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff93d8822619b8) 00000020:00000080:0.0:1787560681.910333:0:15711:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787560681.937300:0:15711:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787560681.937530:0:15711:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787560681.938542:0:15711:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787560681.938772:0:15711:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787560681.939253:0:15711:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787560681.939628:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 489: rc = 0 00100000:10000000:0.0:1787560681.939771:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 489: rc = 0 00100000:10000000:0.0:1787560681.940340:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 489: rc = 0 00100000:10000000:0.0:1787560681.940732:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 305: rc = 0 00100000:10000000:0.0:1787560681.941010:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 305: rc = 0 00100000:10000000:0.0:1787560681.941438:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 305: rc = 0 00100000:10000000:0.0:1787560681.941690:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 305: rc = 0 00100000:10000000:0.0:1787560681.942088:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 305: rc = 0 00100000:10000000:0.0:1787560681.942390:0:15711:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 305: rc = 0 00000020:00000080:0.0:1787560681.946438:0:15711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787560681.946455:0:15711:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787560681.946469:0:15711:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe34191b0567401ba 00000020:01000004:0.0:1787560681.946479:0:15711:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787560681.946505:0:15711:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.156@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787560681.946509:0:15711:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787560681.946516:0:15711:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787560681.946547:0:15711:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787560681.946552:0:15711:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787560681.960723:0:15711:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787560681.960777:0:15711:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.156@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787560681.960782:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787560681.960784:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787560681.960786:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560681.960787:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560681.960788:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560681.960789:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560681.960791:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560681.960793:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560681.960794:0:15711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787560681.961969:0:15711:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787560681.961976:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787560681.961978:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787560681.961979:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560681.961980:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560681.961981:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560681.961983:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560681.961984:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560681.961986:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560681.961987:0:15711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787560681.962025:0:15711:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787560681.962047:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600128:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787560681.962301:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560681.962411:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560681.965293:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815600128 00000100:00100000:3.0:1787560681.965308:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815600128 00000100:00100000:3.0:1787560681.965424:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787560681.965435:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+16:15711:x1874392815600128:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787560681.965473:0:14305:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787560681.965478:0:14305:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787560681.965481:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787560681.986475:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+16:15711:x1874392815600128:12345-0@lo:253:mount.lustre.0 Request processed in 21032us (24165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560681.986490:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787560681.991092:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600128:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787560681.991132:0:15711:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787560681.991135:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787560681.991137:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787560681.991138:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560681.991140:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560681.991141:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560681.991142:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560681.991143:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560681.991145:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560681.991146:0:15711:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787560681.991174:0:15711:0:(tgt_mount.c:101:server_register_mount()) register mount ffff93d881854800 from lustre-OST0001 10000000:01000000:1.0:1787560681.991207:0:15711:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787560681.991210:0:15711:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787560681.991218:0:15711:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93d9894fb370 local copy 00010000:00010000:1.0:1787560681.991229:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff6e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560681.991481:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560681.991541:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560681.991593:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787560681.991680:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815600256 00000100:00100000:3.0:1787560681.991687:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815600256 00000100:00100000:3.0:1787560681.991738:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787560681.991748:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+16:15711:x1874392815600256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560681.992051:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+16:15711:x1874392815600256:12345-0@lo:501:mount.lustre.0 Request processed in 303us (508us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787560681.992059:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787560681.992152:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600256:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787560681.992168:0:15711:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787560681.992284:0:15711:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787560681.992291:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff6e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560681.992301:0:15711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812eac00/0xe34191b05673ff67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05673ff6e expref: -99 pid: 14292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560681.992322:0:15711:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff93d881854800 10000000:01000000:1.0:1787560681.992333:0:15711:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787560681.992338:0:15711:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787560681.992341:0:15711:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787560681.992345:0:15711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787560681.992348:0:15711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787560681.992370:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4261400/0xe34191b0567401c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560681.992379:0:15711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9b4261400/0xe34191b0567401c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560681.992388:0:15711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9b4261400/0xe34191b0567401c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560681.992402:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787560681.992430:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560681.992461:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bb26f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787560681.992530:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815600384 00000100:00100000:0.0:1787560681.992535:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815600384 00000100:00100000:0.0:1787560681.992573:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787560681.992581:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+16:15711:x1874392815600384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560681.992590:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560681.992603:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d990100000/0xe34191b0567401c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b0567401c1 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560681.992626:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d990100000/0xe34191b0567401c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b0567401c1 expref: 17 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560681.992636:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d990100000/0xe34191b0567401c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b0567401c1 expref: 17 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560681.992644:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990100000, rc 0) 00000100:00100000:0.0:1787560681.992685:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+17:15711:x1874392815600384:12345-0@lo:101:mount.lustre.0 Request processed in 105us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560681.992691:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787560681.992787:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560681.992800:0:15711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9b4261400/0xe34191b0567401c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567401c8 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560681.992808:0:15711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9b4261400/0xe34191b0567401c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b0567401c8 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560681.993431:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787560681.994254:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560681.994479:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787560681.994523:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787560681.994555:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787560681.994601:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787560681.994649:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787560681.994682:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787560681.994750:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787560681.994757:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787560681.994837:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560681.994942:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560681.994980:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9babce600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560681.995070:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815600512 00000100:00100000:1.0:1787560681.995078:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815600512 00000100:00100000:1.0:1787560681.995113:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787560681.995123:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+17:15711:x1874392815600512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560681.995529:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+17:15711:x1874392815600512:12345-0@lo:501:mount.lustre.0 Request processed in 406us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560681.995538:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787560681.999499:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560681.999569:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560681.999652:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560681.999698:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9babce600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560681.999965:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815600640 00000100:00100000:1.0:1787560681.999973:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815600640 00000100:00100000:1.0:1787560682.000026:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787560682.000035:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+17:15711:x1874392815600640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560682.000377:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+17:15711:x1874392815600640:12345-0@lo:503:mount.lustre.0 Request processed in 343us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560682.000392:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787560682.000561:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600640:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787560682.004494:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560682.004611:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560682.004700:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560682.004950:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9babce600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560682.013285:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815600768 00000100:00100000:3.0:1787560682.013304:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815600768 00000100:00100000:3.0:1787560682.013371:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787560682.013382:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+17:15711:x1874392815600768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560682.013709:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+17:15711:x1874392815600768:12345-0@lo:502:mount.lustre.0 Request processed in 329us (9009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560682.013717:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560682.014004:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560682.014305:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787560682.014363:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787560682.014396:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787560682.014453:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787560682.014489:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787560682.014523:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787560682.014571:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787560682.014608:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787560682.014650:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787560682.014688:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560682.014742:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560682.014835:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9babce600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560682.015091:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815600896 00000100:00100000:0.0:1787560682.015098:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815600896 00000100:00100000:0.0:1787560682.015140:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787560682.015148:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+17:15711:x1874392815600896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560682.015314:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+17:15711:x1874392815600896:12345-0@lo:502:mount.lustre.0 Request processed in 165us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560682.015322:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560682.015882:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815600896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560682.015976:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787560682.015989:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787560682.016881:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787560682.016890:0:15712:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787560682.016897:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560682.016899:0:15712:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787560682.016905:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560682.016934:0:15712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff93d882d24d28) 00000020:00000080:2.0:1787560682.016957:0:15712:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787560682.016964:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787560682.017028:0:15712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d881854800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787560682.017036:0:15712:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787560682.017042:0:15712:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe34191b0567401d6 00010000:00010000:2.0:1787560682.023663:0:15712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1787560682.024212:0:15712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787560682.026519:0:15712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787560682.034015:0:15712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787560682.034028:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560682.034035:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560682.034037:0:15712:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787560682.034043:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560682.034046:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560682.034048:0:15712:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787560682.034051:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787560682.034053:0:15712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787560682.034055:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560682.034057:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560682.034058:0:15712:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787560682.034060:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560682.034063:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560682.034064:0:15712:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787560682.034067:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787560682.034134:0:15712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560682.034138:0:15712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560682.034140:0:15712:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787560682.034143:0:15712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787560682.034474:0:15711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787560682.034499:0:15711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787560682.034525:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9b4261400/0xe34191b0567401c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567401c8 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.034537:0:15711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9b4261400/0xe34191b0567401c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567401c8 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560682.034546:0:15711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d881854800 from 1 10000000:01000000:2.0:1787560682.034549:0:15711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560682.034584:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.034602:0:15711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.034613:0:15711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560682.034638:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560682.034707:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560682.034749:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9babce180 going to sleep for 11 seconds 00000100:00100000:0.0:1787560682.034958:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815601024 00000100:00100000:0.0:1787560682.034966:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815601024 00000100:00100000:0.0:1787560682.035002:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787560682.035012:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+17:15711:x1874392815601024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560682.035026:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560682.035039:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d990101800/0xe34191b0567401e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b0567401dd expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560682.035063:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d990101800/0xe34191b0567401e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b0567401dd expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560682.035073:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d990101800/0xe34191b0567401e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b0567401dd expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560682.035093:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d990101800, rc 0) 00000100:00100000:0.0:1787560682.035140:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815601024:12345-0@lo:101:mount.lustre.0 Request processed in 128us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560682.035147:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560682.035260:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560682.035272:0:15711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.035282:0:15711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560682.035790:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787560682.036217:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560682.036452:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787560682.036492:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787560682.036544:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787560682.036551:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787560682.036607:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560682.036651:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560682.036682:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9babce180 going to sleep for 11 seconds 00000100:00100000:3.0:1787560682.036913:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815601152 00000100:00100000:3.0:1787560682.036920:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815601152 00000100:00100000:3.0:1787560682.036967:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787560682.036976:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815601152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560682.037175:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815601152:12345-0@lo:501:mount.lustre.0 Request processed in 199us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560682.037182:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787560682.039309:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560682.039366:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560682.039432:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560682.039506:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9babce180 going to sleep for 11 seconds 00000100:00100000:0.0:1787560682.040587:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815601280 00000100:00100000:0.0:1787560682.040598:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815601280 00000100:00100000:0.0:1787560682.040654:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787560682.040664:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815601280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560682.041383:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815601280:12345-0@lo:503:mount.lustre.0 Request processed in 717us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560682.041392:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787560682.041484:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601280:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787560682.042020:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560682.042096:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560682.042143:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560682.042183:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d98357c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787560682.042288:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815601408 00000100:00100000:0.0:1787560682.042294:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815601408 00000100:00100000:0.0:1787560682.042335:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787560682.042345:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815601408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560682.042533:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815601408:12345-0@lo:502:mount.lustre.0 Request processed in 189us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560682.042541:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560682.042700:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560682.043385:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787560682.043440:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787560682.043495:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787560682.043531:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787560682.043566:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787560682.043630:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787560682.043669:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787560682.043704:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787560682.043741:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560682.043813:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560682.043938:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815601536 00000100:00100000:0.0:1787560682.043945:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815601536 00000100:00100000:0.0:1787560682.043998:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787560682.044008:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8822af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815601536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560682.044185:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8822af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815601536:12345-0@lo:502:mount.lustre.0 Request processed in 178us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560682.044193:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787560682.044366:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9babce180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560682.044387:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560682.044477:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787560682.044486:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787560682.045343:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560682.045354:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560682.045357:0:15716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787560682.045364:0:15716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d881854800 00000020:00000080:1.0:1787560682.045367:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560682.045375:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560682.045378:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560682.045379:0:15716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787560682.045381:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560682.045383:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560682.045384:0:15716:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787560682.045386:0:15716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff93d881854800 00000020:00000080:1.0:1787560682.045387:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560682.045461:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560682.045464:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560682.045465:0:15716:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787560682.045466:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560682.045468:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560682.045468:0:15716:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787560682.045470:0:15716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff93d881854800 00000020:00000080:1.0:1787560682.045471:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560682.046969:0:15716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560682.046978:0:15716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560682.046980:0:15716:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787560682.046984:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787560682.047153:0:15711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787560682.047180:0:15711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787560682.047206:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560682.047218:0:15711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560682.047270:0:15711:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787560682.047273:0:15711:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff93d881854800 10000000:01000000:3.0:1787560682.047277:0:15711:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff93d881854800 10000000:01000000:3.0:1787560682.047282:0:15711:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787560682.047288:0:15711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff93d881854800 from 1 10000000:01000000:3.0:1787560682.047290:0:15711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787560682.047324:0:15711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b0567401eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560682.047333:0:15711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b0567401eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560682.047343:0:15711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b0567401eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560682.047366:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601664:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560682.047438:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560682.047477:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815601664 00000100:00100000:3.0:1787560682.047484:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815601664 00000100:00100000:3.0:1787560682.047530:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787560682.047539:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8822af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815601664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560682.047551:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560682.047563:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21dae00/0xe34191b0567401f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b0567401eb expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560682.047584:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21dae00/0xe34191b0567401f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b0567401eb expref: 19 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560682.047595:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21dae00/0xe34191b0567401f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b0567401eb expref: 19 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560682.047604:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21dae00, rc 0) 00000100:00100000:3.0:1787560682.047635:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8822af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+19:15711:x1874392815601664:12345-0@lo:101:mount.lustre.0 Request processed in 97us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560682.047642:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787560682.047682:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9867849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560682.047704:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601664:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560682.047717:0:15711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b0567401eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567401f2 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560682.047726:0:15711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b0567401eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b0567401f2 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560682.048476:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787560682.048923:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560682.049187:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787560682.049233:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787560682.049270:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787560682.049317:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787560682.049353:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787560682.049401:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787560682.049438:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787560682.049473:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787560682.049524:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787560682.049561:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787560682.049618:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787560682.049669:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787560682.049707:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787560682.049742:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787560682.049793:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787560682.049830:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787560682.049906:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787560682.049955:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787560682.049991:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787560682.050026:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787560682.050069:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787560682.050100:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787560682.050126:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787560682.050168:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787560682.050203:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787560682.050237:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787560682.050304:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787560682.050342:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787560682.050376:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787560682.050449:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787560682.050487:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787560682.050522:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787560682.050565:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787560682.050608:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787560682.050643:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787560682.050685:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787560682.050716:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787560682.050805:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787560682.050813:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787560682.057320:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560682.057398:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560682.058928:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9867849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560682.060950:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815601792 00000100:00100000:1.0:1787560682.060965:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815601792 00000100:00100000:1.0:1787560682.061020:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787560682.061031:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+19:15711:x1874392815601792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560682.061326:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+19:15711:x1874392815601792:12345-0@lo:501:mount.lustre.0 Request processed in 297us (3928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560682.061341:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787560682.061901:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560682.061948:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560682.061993:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560682.062024:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9867849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560682.062131:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815601920 00000100:00100000:1.0:1787560682.062136:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815601920 00000100:00100000:1.0:1787560682.062172:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787560682.062180:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+19:15711:x1874392815601920:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560682.062399:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+19:15711:x1874392815601920:12345-0@lo:503:mount.lustre.0 Request processed in 219us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560682.062407:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787560682.062485:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815601920:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787560682.063183:0:15711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560682.063256:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815602048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560682.063302:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560682.063328:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9867849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560682.063421:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815602048 00000100:00100000:1.0:1787560682.063427:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815602048 00000100:00100000:1.0:1787560682.063455:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787560682.063463:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+19:15711:x1874392815602048:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560682.063682:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+19:15711:x1874392815602048:12345-0@lo:502:mount.lustre.0 Request processed in 219us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560682.063688:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787560682.063947:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815602048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560682.064263:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787560682.064314:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787560682.064350:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787560682.064413:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787560682.064454:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787560682.064507:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787560682.064548:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787560682.064595:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787560682.064649:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787560682.064783:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787560682.064820:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787560682.065120:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787560682.065159:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787560682.065191:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787560682.065234:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787560682.065270:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787560682.065302:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787560682.065361:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787560682.065397:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787560682.065429:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787560682.065473:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787560682.065507:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787560682.065537:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787560682.065581:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787560682.065616:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787560682.065648:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787560682.065697:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787560682.065732:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787560682.065766:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787560682.065814:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787560682.065887:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787560682.065925:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787560682.065958:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787560682.066021:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787560682.066059:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787560682.066106:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787560682.066140:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787560682.066172:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787560682.066217:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787560682.066250:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787560682.066303:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815602176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560682.066372:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560682.066418:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9867849c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560682.067365:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815602176 00000100:00100000:0.0:1787560682.067374:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815602176 00000100:00100000:0.0:1787560682.067427:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787560682.067437:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+19:15711:x1874392815602176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560682.067668:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+19:15711:x1874392815602176:12345-0@lo:502:mount.lustre.0 Request processed in 232us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560682.067677:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787560682.067826:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815602176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560682.068009:0:15711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787560682.068022:0:15711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787560682.068998:0:15721:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787560682.069014:0:15721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93d9894f8000) 00000020:00000080:3.0:1787560682.069036:0:15721:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787560682.069103:0:15721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff93d881854800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787560682.069108:0:15721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff93d881854800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787560682.069110:0:15721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff93d881854800 3 00010000:00080000:3.0:1787560682.069143:0:15721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93d9865b6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.156@tcp at head 00010000:00010000:3.0:1787560682.073525:0:15721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787560682.073777:0:15721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787560682.073814:0:15721:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787560682.073833:0:15721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe34191b056740200 00000100:00080000:3.0:1787560682.073882:0:15721:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560682.073889:0:15721:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff93d9865b6000 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1787560682.073924:0:15721:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9894c7b80 x1874392815602304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560682.073949:0:15721:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787560682.073992:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560682.073996:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787560682.073998:0:8:0:(import.c:65:import_set_state_nolock()) ffff93d9ba32b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560682.074002:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:3.0:1787560682.074006:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787560682.074016:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d9ba32b800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:3.0:1787560682.074030:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d9894c5180 x1874392815602560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560682.074072:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560682.074086:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815602432:0@lo:400:kworker.0 00000100:00100000:3.0:1787560682.074151:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560682.074191:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815602688:0@lo:400:kworker.0 00000100:00100000:3.0:1787560682.074217:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560682.074234:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560682.074239:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815602816:0@lo:400:kworker.0 00000100:00100000:3.0:1787560682.074257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560682.074286:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815602432 00000100:00100000:3.0:1787560682.074293:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815602432 00000100:00100000:3.0:1787560682.074344:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560682.074354:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815602432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560682.074402:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815602432:12345-0@lo:400:kworker.0 Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560682.074408:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560682.074428:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815602688 00000100:00100000:3.0:1787560682.074431:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815602688 00000100:00100000:3.0:1787560682.074454:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815602816 00000100:00100000:3.0:1787560682.074456:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815602816 00000100:00100000:3.0:1787560682.074483:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560682.074490:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815602688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560682.074524:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815602688:12345-0@lo:400:kworker.0 Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560682.074530:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560682.074551:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560682.074557:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815602816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560682.074586:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815602816:12345-0@lo:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560682.074592:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787560682.074611:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560682.074615:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560682.074644:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9894c4380 x1874392815602816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560682.074657:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815602816:0@lo:400:kworker.0 00010000:00080000:3.0:1787560682.074668:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9894c6d80 x1874392815602688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560682.074677:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815602688:0@lo:400:kworker.0 00000100:00100000:3.0:1787560682.074703:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787560682.074713:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815602432:0@lo:400:kworker.0 00000100:00100000:1.0:1787560682.074820:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874392815602304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787560682.074881:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560682.074906:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815602560:0@lo:8:kworker.0 00000100:00100000:1.0:1787560682.074938:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560682.074974:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815602304 00000100:00100000:1.0:1787560682.074978:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815602304 00000100:00100000:1.0:1787560682.074997:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560682.075002:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874392815602304:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787560682.075022:0:14310:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:1.0:1787560682.075051:0:14310:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe34191b056740207 00000004:00100000:1.0:1787560682.075071:0:14310:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787560682.075099:0:14310:0:(import.c:65:import_set_state_nolock()) ffff93d882df8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560682.075132:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874392815602304:12345-0@lo:38:llog_process_th.0 Request processed in 129us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560682.075138:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787560682.075158:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815602560 00000100:00100000:1.0:1787560682.075161:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815602560 00000100:00100000:1.0:1787560682.075177:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560682.075180:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874392815602560:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787560682.075210:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874392815602560:12345-0@lo:8:kworker.0 Request processed in 28us (272us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787560682.075215:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787560682.075238:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff93d9894c7b80 x1874392815602304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560682.075245:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560682.075250:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787560682.075256:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787560682.075260:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787560682.075262:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9865b6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787560682.075267:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874392815602304:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787560682.075275:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560682.075277:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9ba32b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560682.075280:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787560682.075283:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815602560:0@lo:8:kworker.0 00000040:00080000:3.0:1787560682.082038:0:15721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787560682.082145:0:15711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787560682.082180:0:15711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787560682.082204:0:15711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b0567401eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567401f2 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560682.082217:0:15711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9c21da600/0xe34191b0567401eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567401f2 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787560682.082261:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787560682.082264:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787560682.082265:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560682.082266:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560682.082268:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560682.082270:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560682.082271:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560682.082273:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560682.082274:0:15711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560682.082279:0:15711:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787560682.082281:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787560682.082283:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787560682.082284:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560682.082285:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560682.082286:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560682.082287:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560682.082288:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560682.082289:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560682.082290:0:15711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560682.082320:0:15711:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787560682.082341:0:15711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815602944:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787560682.082411:0:15711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560682.082457:0:15711:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9873f4240 going to sleep for 11 seconds 00000100:00100000:1.0:1787560682.082531:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815602944 00000100:00100000:1.0:1787560682.082538:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815602944 00000100:00100000:1.0:1787560682.082623:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787560682.082633:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+19:15711:x1874392815602944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560682.082677:0:14305:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787560682.082692:0:14305:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787560682.121164:0:14305:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787560682.121214:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787560682.122872:0:14326:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787560682.122880:0:14326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787560682.122905:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.122923:0:14326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9812ebc00/0xe34191b0567400e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b0567400e1 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.122946:0:14326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.122989:0:14326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9812ebc00/0xe34191b0567400e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b0567400e1 expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.123003:0:14326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9812ebc00/0xe34191b0567400e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b0567400e1 expref: 19 pid: 14305 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560682.123019:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14326:1874392815603072:0@lo:104: 00000100:00100000:2.0:1787560682.123083:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560682.123135:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998bbc180 going to sleep for 11 seconds 00000100:00100000:2.0:1787560682.123153:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815603072 00000100:00100000:2.0:1787560682.123160:0:14294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815603072 00000100:00100000:2.0:1787560682.123210:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560682.123219:0:14294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:449b2653-031b-4a00-838c-f2377a91f8ff+3:14326:x1874392815603072:12345-0@lo:104: 00010000:00010000:2.0:1787560682.123231:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.123281:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560682.123287:0:14294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:449b2653-031b-4a00-838c-f2377a91f8ff+3:14326:x1874392815603072:12345-0@lo:104: Request processed in 70us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560682.123294:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787560682.123315:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560682.123321:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.123328:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:2.0:1787560682.123340:0:14298:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.123349:0:14298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560682.123358:0:14298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560682.123364:0:14298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560682.123395:0:14298:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.123403:0:14298:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560682.123431:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.123439:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9812eba00/0xe34191b0567400e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b0567400e8 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.123461:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560682.123463:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560682.123465:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560682.123500:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14326:1874392815603072:0@lo:104: 00010000:00010000:2.0:1787560682.123520:0:14326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560682.123712:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560682.123726:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:449b2653-031b-4a00-838c-f2377a91f8ff:3312:1874392815603200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560682.123758:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560682.123833:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815603200 00000100:00100000:2.0:1787560682.123877:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815603200 00010000:00010000:2.0:1787560682.123898:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9812ebc00/0xe34191b0567400e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b0567400e1 expref: 20 pid: 14305 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560682.123933:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560682.123940:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449b2653-031b-4a00-838c-f2377a91f8ff+20:3312:x1874392815603200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560682.123950:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560682.123956:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9812ebc00/0xe34191b0567400e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b0567400e1 expref: 20 pid: 14305 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.123965:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9812ebc00/0xe34191b0567400e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b0567400e1 expref: 20 pid: 14305 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.123979:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9812ebc00/0xe34191b0567400e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b0567400e1 expref: 20 pid: 14305 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.123992:0:14297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.124000:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787560682.124012:0:14297:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008049395s 00010000:00010000:2.0:1787560682.124016:0:14297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.124023:0:14297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.124031:0:14297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.124037:0:14297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.124049:0:14297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560682.124053:0:14297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.124060:0:14297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.124073:0:14297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.124083:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560682.124297:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449b2653-031b-4a00-838c-f2377a91f8ff+19:3312:x1874392815603200:12345-0@lo:103:ldlm_bl.0 Request processed in 356us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560682.124304:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787560682.124325:0:14326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.124332:0:14326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560682.124339:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98a711600/0xe34191b05674020e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560682.127018:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560682.127594:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:449b2653-031b-4a00-838c-f2377a91f8ff:3312:1874392815603200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560682.128016:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+18:15711:x1874392815602944:12345-0@lo:253:mount.lustre.0 Request processed in 45382us (45603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560682.128027:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787560682.128194:0:15711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:449b2653-031b-4a00-838c-f2377a91f8ff:15711:1874392815602944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787560682.128208:0:15711:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787560682.128212:0:15711:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787560682.128214:0:15711:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787560682.128215:0:15711:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787560682.128217:0:15711:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787560682.128218:0:15711:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787560682.128219:0:15711:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787560682.128221:0:15711:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787560682.128223:0:15711:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787560682.128224:0:15711:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787560682.128235:0:15711:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787560682.132776:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787560682.132991:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787560682.133215:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787560682.133370:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787560682.133525:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787560682.133727:0:15711:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787560682.135815:0:15711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787560682.198957:0:15711:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787560682.198967:0:15711:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787560682.199013:0:15711:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787560682.199074:0:15711:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787560682.199089:0:15711:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787560682.199130:0:15711:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787560683.164775:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560683.222630:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560683.222657:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815603328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560683.222726:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560683.223975:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815603328 00000100:00100000:0.0:1787560683.223989:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815603328 00000100:00100000:0.0:1787560683.224052:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787560683.224064:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815603328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560683.224104:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560683.224170:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815603328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560683.224194:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560683.224276:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815603328:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1787560683.343043:0:14307:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787560683.343052:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff93d9bad52800 from 8 10000000:01000000:2.0:1787560683.343058:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787560683.343368:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d98a710800/0xe34191b056740215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560683.343381:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d98a710800/0xe34191b056740215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560683.343415:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d98a710800/0xe34191b056740215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560683.343502:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815603456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560683.343581:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560683.343958:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815603456 00000100:00100000:1.0:1787560683.343966:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815603456 00000100:00100000:1.0:1787560683.344015:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787560683.344023:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+18:14307:x1874392815603456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560683.344036:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560683.344050:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4260800/0xe34191b05674021c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b056740215 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560683.344086:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4260800/0xe34191b05674021c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b056740215 expref: 19 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560683.344099:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4260800/0xe34191b05674021c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b056740215 expref: 19 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560683.344109:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260800, rc 0) 00000100:00100000:1.0:1787560683.344162:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+19:14307:x1874392815603456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560683.344170:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787560683.344345:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560683.344371:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815603456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560683.344387:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d98a710800/0xe34191b056740215 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05674021c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560683.344397:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d98a710800/0xe34191b056740215 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b05674021c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560683.344462:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815603584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787560683.344496:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560683.344871:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815603584 00000100:00100000:1.0:1787560683.344877:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815603584 00000100:00100000:1.0:1787560683.344922:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787560683.344929:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+19:14307:x1874392815603584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787560683.344944:0:14305:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560683.344961:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560683.344965:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787560683.345044:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+19:14307:x1874392815603584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560683.345051:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787560683.346394:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560683.346426:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815603584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787560683.346521:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787560683.346530:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d98a710800/0xe34191b056740215 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05674021c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560683.346541:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d98a710800/0xe34191b056740215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b05674021c expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560684.178408:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560684.499171:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560685.214089:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560686.223570:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.261328:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560687.317168:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560687.317175:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787560687.317179:0:38:0:(import.c:65:import_set_state_nolock()) ffff93d9ba32b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560687.317193:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff93d9ba32b800 using connection 192.168.201.156@tcp/0@lo 00000100:00100000:2.0:1787560687.317214:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93d986a02300 x1874392815603968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560687.317283:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449b2653-031b-4a00-838c-f2377a91f8ff:3313:1874392815603712:0@lo:400:kworker.0 00000100:00100000:2.0:1787560687.317351:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560687.317397:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815604352:0@lo:400:kworker.0 00000100:00100000:2.0:1787560687.317437:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560687.317465:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560687.317471:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815603840:0@lo:400:kworker.0 00000100:00100000:2.0:1787560687.317497:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560687.317530:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815603968:0@lo:8:kworker.0 00000100:00100000:2.0:1787560687.317554:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560687.317582:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815604096:0@lo:400:kworker.0 00000100:00100000:2.0:1787560687.317605:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560687.317621:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560687.317627:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d986a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815604224:0@lo:400:kworker.0 00000100:00100000:2.0:1787560687.317647:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560687.317680:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815603712 00000100:00100000:2.0:1787560687.317687:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815603712 00000100:00100000:2.0:1787560687.317731:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787560687.317740:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+19:3313:x1874392815603712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560687.317798:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+19:3313:x1874392815603712:12345-0@lo:400:kworker.0 Request processed in 59us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560687.317805:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787560687.317837:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815604352 00000100:00100000:2.0:1787560687.317840:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815604352 00000100:00100000:2.0:1787560687.317900:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815604096 00000100:00100000:2.0:1787560687.317904:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815604096 00000100:00100000:2.0:1787560687.317915:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815604224 00000100:00100000:2.0:1787560687.317918:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815604224 00000100:00100000:2.0:1787560687.317930:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560687.317936:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815604352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560687.317969:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815604352:12345-0@lo:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560687.317983:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560687.317996:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560687.318002:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815604096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560687.318112:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815604096:12345-0@lo:400:kworker.0 Request processed in 110us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560687.318119:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560687.318131:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560687.318138:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815604224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560687.318164:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815604224:12345-0@lo:400:kworker.0 Request processed in 26us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560687.318169:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560687.318192:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815603840 00000100:00100000:2.0:1787560687.318196:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815603840 00000100:00100000:2.0:1787560687.318221:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815603968 00000100:00100000:2.0:1787560687.318224:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815603968 00000100:00100000:2.0:1787560687.318233:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560687.318239:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815603840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560687.318268:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815603840:12345-0@lo:400:kworker.0 Request processed in 29us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560687.318274:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560687.318286:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560687.318290:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874392815603968:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787560687.318317:0:14998:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1787560687.318345:0:14998:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe34191b056740223 00002000:00100000:2.0:1787560687.318359:0:14998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff93d9b38e0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787560687.318370:0:14998:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787560687.318373:0:14998:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787560687.318697:0:14998:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787560687.318720:0:14998:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560687.318777:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874392815603968:12345-0@lo:8:kworker.0 Request processed in 484us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560687.318783:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787560687.318815:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560687.318820:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787560687.318875:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986a02300 x1874392815603968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787560687.318891:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787560687.318899:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787560687.318904:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787560687.318906:0:3310:0:(import.c:65:import_set_state_nolock()) ffff93d9ba32b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787560687.318918:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787560687.318923:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874392815603968:0@lo:8:kworker.0 00000004:00080000:2.0:1787560687.318973:0:14335:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1787560687.318989:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14335:1874392815604608:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787560687.320306:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560687.320336:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9ba7a0a80 going to sleep for 11 seconds 00000004:00080000:2.0:1787560687.320358:0:14334:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787560687.320787:0:14334:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 516073938724ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787560687.320817:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815604480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560687.320872:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560687.320912:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815604480 00000100:00100000:2.0:1787560687.320925:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815604480 00000100:00100000:2.0:1787560687.320988:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560687.320997:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815604480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560687.324614:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560687.324709:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874392815604480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3709us (3833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560687.324721:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787560687.324816:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787560687.329352:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d9bb0fc380 x1874392815604480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560687.329379:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815604480:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787560687.336155:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986a00e00 x1874392815604224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560687.336174:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815604224:0@lo:400:kworker.0 00010000:00080000:2.0:1787560687.336189:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986a02d80 x1874392815604096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560687.336198:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815604096:0@lo:400:kworker.0 00000100:00100000:0.0:1787560687.338744:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815604608 00000100:00100000:0.0:1787560687.338769:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815604608 00000100:00100000:0.0:1787560687.338822:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560687.338832:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14335:x1874392815604608:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787560687.347725:0:14998:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787560687.347737:0:14998:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787560687.347742:0:14998:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:1.0:1787560687.352944:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815603840:0@lo:400:kworker.0 00000100:00100000:1.0:1787560687.352961:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449b2653-031b-4a00-838c-f2377a91f8ff:3313:1874392815603712:0@lo:400:kworker.0 00010000:00080000:1.0:1787560687.352974:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93d986a01880 x1874392815604352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560687.352985:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d986a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815604352:0@lo:400:kworker.0 00002000:00010000:0.0:1787560687.371398:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.371411:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b05674022a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.371427:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.371432:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.371439:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b05674022a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.371455:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b05674022a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.371465:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b05674022a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.371473:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b05674022a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.371510:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560687.372947:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560687.372958:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b05674022a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.372971:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101000 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.372977:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b05674022a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.372987:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b05674022a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.373032:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b05674022a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.373041:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b05674022a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.373061:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.373063:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.373065:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560687.374018:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.374029:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b056740231 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.374043:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.374047:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.374053:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b056740231 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.374064:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b056740231 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.374072:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b056740231 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.374079:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b056740231 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.374096:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.374539:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.374546:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740238 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.374555:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.374566:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.374571:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.374580:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.374587:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.374594:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.374609:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787560687.380500:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.380513:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674023f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.380530:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.380535:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.380540:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674023f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.380553:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674023f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.380564:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674023f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.380580:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674023f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.380591:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787560687.381081:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.381087:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740246 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.381097:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.381100:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.381105:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740246 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.381115:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740246 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.381123:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740246 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.381130:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740246 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.381138:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787560687.381528:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.381534:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674024d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.381548:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.381551:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.381555:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674024d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.381564:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674024d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.381572:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674024d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.381579:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674024d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.381586:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787560687.385754:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.385765:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740254 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.385781:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.385786:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.385791:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.385804:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.385825:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740254 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.385832:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.385843:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1787560687.386144:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787560687.386152:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b056740231 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386162:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101e00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.386167:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b056740231 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386176:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b056740231 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386193:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b056740231 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386199:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b056740231 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386231:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787560687.386235:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386241:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101a00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.386244:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386251:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740238 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386260:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740238 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386267:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740238 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386279:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787560687.386282:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674023f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386288:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100e00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.386291:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674023f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386310:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674023f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386321:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674023f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386328:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674023f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386342:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787560687.386345:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740246 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386352:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.386355:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740246 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386362:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740246 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386371:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740246 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386378:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740246 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386404:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560687.386408:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674024d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386414:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100a00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.386417:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674024d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386425:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674024d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386435:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674024d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386442:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674024d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386453:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560687.386456:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386462:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101c00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.386466:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740254 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386484:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740254 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386495:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740254 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386501:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740254 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.386513:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.386515:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.386517:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.386524:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787560687.388710:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787560687.389684:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.389694:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e8e29c2/0xe34191b05674025b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.389711:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.389715:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.389721:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e8e29c2/0xe34191b05674025b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.389735:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e8e29c2/0xe34191b05674025b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.389756:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e8e29c2/0xe34191b05674025b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.389765:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e8e29c2/0xe34191b05674025b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.389801:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.390307:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.390314:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008aacc44/0xe34191b056740262 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390323:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.390326:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.390331:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008aacc44/0xe34191b056740262 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390341:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008aacc44/0xe34191b056740262 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390348:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008aacc44/0xe34191b056740262 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390356:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008aacc44/0xe34191b056740262 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390373:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787560687.390384:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560687.390390:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e8e29c2/0xe34191b05674025b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390397:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560687.390408:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e8e29c2/0xe34191b05674025b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390417:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e8e29c2/0xe34191b05674025b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390434:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e8e29c2/0xe34191b05674025b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390441:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e8e29c2/0xe34191b05674025b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390459:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560687.390463:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008aacc44/0xe34191b056740262 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390469:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560687.390473:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008aacc44/0xe34191b056740262 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390479:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008aacc44/0xe34191b056740262 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390488:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008aacc44/0xe34191b056740262 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390495:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008aacc44/0xe34191b056740262 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.390514:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.390516:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.390518:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.391061:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560687.391491:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.391498:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3917e7/0xe34191b056740269 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.391510:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.391513:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.391519:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3917e7/0xe34191b056740269 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.391529:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb3917e7/0xe34191b056740269 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.391537:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3917e7/0xe34191b056740269 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.391545:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3917e7/0xe34191b056740269 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.393140:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.393731:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.393740:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b056740270 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.393779:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.393783:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.393789:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b056740270 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.393802:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b056740270 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.393811:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b056740270 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.393819:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b056740270 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.398782:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560687.398797:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb3917e7/0xe34191b056740269 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.398812:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100800 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.398817:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3917e7/0xe34191b056740269 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.398828:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3917e7/0xe34191b056740269 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.398878:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb3917e7/0xe34191b056740269 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.398885:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb3917e7/0xe34191b056740269 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.398938:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560687.398943:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b056740270 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.398949:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100200 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.398952:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b056740270 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.398960:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b056740270 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.398970:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b056740270 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.398978:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.398979:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.398981:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.399296:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560687.399305:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf253887/0xe34191b056740270 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.400314:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560687.400484:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.400493:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740277 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.400507:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.400511:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.400518:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.400542:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.400552:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740277 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.400559:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.401080:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.401781:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.401788:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674027e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.401801:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.401805:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.401810:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674027e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.401822:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674027e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.401832:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674027e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.401873:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674027e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.409144:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560687.409160:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.409188:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101c00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.409193:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.409206:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740277 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.409229:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740277 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.409237:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087dbd3e9/0xe34191b056740277 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.409288:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560687.409292:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674027e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.409298:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100a00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.409302:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674027e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.409309:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674027e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.409319:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674027e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.409335:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.409336:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.409338:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.411743:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560687.411767:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001de2796b/0xe34191b05674027e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.412886:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560687.413574:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.413588:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740285 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.413608:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.413612:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.413619:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.413632:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.413647:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740285 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.413655:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.413743:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.414281:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.414286:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674028c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.414296:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.414303:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.414307:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674028c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.414315:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674028c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.414325:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674028c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.414333:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674028c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.415741:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560687.415762:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.415775:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.415779:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740285 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.415788:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740285 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.415806:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740285 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.415812:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac5687c2/0xe34191b056740285 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.415836:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560687.415841:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674028c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.417138:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990100e00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.417159:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674028c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.417170:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674028c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.417187:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674028c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.417198:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.417199:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.417202:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.417459:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560687.417468:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ddb761f/0xe34191b05674028c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560687.418266:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.418275:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740293 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.418293:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.418298:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.418305:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.418317:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.418325:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740293 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.418332:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.421127:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.421808:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.421819:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b05674029a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.421835:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.421840:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.421870:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b05674029a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.421887:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b05674029a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.421911:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b05674029a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.421920:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b05674029a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.424888:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560687.424902:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.424918:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101a00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560687.424923:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740293 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.424934:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740293 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.424962:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740293 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.424978:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002900a547/0xe34191b056740293 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.425020:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560687.425024:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b05674029a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.425031:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101e00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560687.425034:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b05674029a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.425042:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b05674029a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.425053:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b05674029a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.425062:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560687.425063:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560687.425065:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.425996:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.427638:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560687.427651:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e06f064/0xe34191b05674029a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.428102:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560687.428460:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.428468:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b0567402a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.428484:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.428489:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.428496:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b0567402a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.428510:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b0567402a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.428520:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b0567402a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.428552:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b0567402a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.428608:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.429142:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.429148:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c1b755a/0xe34191b0567402a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.429159:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.429162:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.429166:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c1b755a/0xe34191b0567402a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.429177:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c1b755a/0xe34191b0567402a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.429184:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c1b755a/0xe34191b0567402a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.429191:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c1b755a/0xe34191b0567402a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.429622:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560687.429630:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b0567402a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.429639:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d990101000 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.429643:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b0567402a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.429653:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b0567402a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.429670:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b0567402a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.429691:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b1c198c/0xe34191b0567402a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.429714:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560687.429718:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c1b755a/0xe34191b0567402a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.429724:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebc00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.429727:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c1b755a/0xe34191b0567402a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.429735:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c1b755a/0xe34191b0567402a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.429755:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c1b755a/0xe34191b0567402a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.429763:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.429765:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.429767:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.430019:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560687.430025:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c1b755a/0xe34191b0567402a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560687.430553:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.430560:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b0567402af lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.430570:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.430574:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.430579:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b0567402af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.430589:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b0567402af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.430597:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b0567402af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.430604:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b0567402af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.431092:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560687.431100:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b0567402af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.431108:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.431118:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b0567402af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.431127:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b0567402af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.431140:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b0567402af lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.431169:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.431171:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.431172:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.433291:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560687.433304:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b0567402af lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560687.434102:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.434111:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea0318e/0xe34191b0567402b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434136:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.434141:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.434148:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ea0318e/0xe34191b0567402b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434161:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ea0318e/0xe34191b0567402b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434171:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ea0318e/0xe34191b0567402b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434179:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ea0318e/0xe34191b0567402b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434199:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.434599:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.434605:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cd787f2/0xe34191b0567402bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434614:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.434617:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.434621:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cd787f2/0xe34191b0567402bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434630:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cd787f2/0xe34191b0567402bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434649:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cd787f2/0xe34191b0567402bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434655:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cd787f2/0xe34191b0567402bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434663:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787560687.434877:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560687.434884:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ea0318e/0xe34191b0567402b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434892:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebe00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560687.434897:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea0318e/0xe34191b0567402b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434906:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ea0318e/0xe34191b0567402b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434921:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ea0318e/0xe34191b0567402b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434929:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ea0318e/0xe34191b0567402b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434950:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560687.434960:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cd787f2/0xe34191b0567402bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434967:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eaa00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560687.434970:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cd787f2/0xe34191b0567402bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434977:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cd787f2/0xe34191b0567402bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434988:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cd787f2/0xe34191b0567402bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.434994:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cd787f2/0xe34191b0567402bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.435116:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.435168:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.435171:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.435172:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560687.435438:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.435445:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b93a8e/0xe34191b0567402c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.435455:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.435458:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.435462:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b93a8e/0xe34191b0567402c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.435483:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b93a8e/0xe34191b0567402c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.435491:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b93a8e/0xe34191b0567402c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.435497:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b93a8e/0xe34191b0567402c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.435554:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.436278:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.436286:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc4637b/0xe34191b0567402cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.436296:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.436300:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.436304:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc4637b/0xe34191b0567402cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.436316:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc4637b/0xe34191b0567402cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.436324:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fc4637b/0xe34191b0567402cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.436342:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fc4637b/0xe34191b0567402cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.436433:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560687.436440:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b93a8e/0xe34191b0567402c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.436448:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eae00 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.436452:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b93a8e/0xe34191b0567402c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.436459:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b93a8e/0xe34191b0567402c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.436473:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b93a8e/0xe34191b0567402c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.436480:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b93a8e/0xe34191b0567402c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.436505:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560687.436509:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fc4637b/0xe34191b0567402cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.436515:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb800 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560687.436518:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc4637b/0xe34191b0567402cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.436526:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fc4637b/0xe34191b0567402cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.436536:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fc4637b/0xe34191b0567402cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560687.436543:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.436545:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.436547:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.436579:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560687.436585:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc4637b/0xe34191b0567402cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560687.437200:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.437207:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b0567402d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.437217:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.437221:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.437226:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b0567402d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.437236:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b0567402d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.437244:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b0567402d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.437251:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b0567402d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.437287:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.437679:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.437685:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edc749da/0xe34191b0567402d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.437694:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.437698:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.437702:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edc749da/0xe34191b0567402d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.437710:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edc749da/0xe34191b0567402d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.437718:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edc749da/0xe34191b0567402d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.437725:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edc749da/0xe34191b0567402d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.437733:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787560687.438104:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560687.438111:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b0567402d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.438120:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea800 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560687.438131:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b0567402d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.438141:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b0567402d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.438155:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b0567402d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.438162:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b0567402d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.438182:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560687.438185:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edc749da/0xe34191b0567402d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.438191:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea400 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560687.438195:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edc749da/0xe34191b0567402d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.438201:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edc749da/0xe34191b0567402d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.438210:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edc749da/0xe34191b0567402d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.438216:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edc749da/0xe34191b0567402d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.438234:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560687.438236:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560687.438238:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560687.438301:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560687.438495:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.438500:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4342d71/0xe34191b0567402e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.438508:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.438517:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.438522:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4342d71/0xe34191b0567402e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.438531:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4342d71/0xe34191b0567402e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.438539:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4342d71/0xe34191b0567402e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.438546:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4342d71/0xe34191b0567402e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.438598:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560687.439113:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787560687.439119:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b0567402e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.439128:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=516s v=(0 0) 00010000:00010000:0.0:1787560687.439131:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560687.439135:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b0567402e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.439143:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b0567402e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.439150:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b0567402e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560687.439163:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b0567402e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.441778:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560687.441791:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4342d71/0xe34191b0567402e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.441804:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb000 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560687.441809:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4342d71/0xe34191b0567402e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.441819:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4342d71/0xe34191b0567402e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.441838:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4342d71/0xe34191b0567402e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.441866:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4342d71/0xe34191b0567402e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.441898:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560687.441902:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b0567402e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.441909:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eb600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:2.0:1787560687.441923:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b0567402e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.441932:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b0567402e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.441942:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b0567402e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560687.441950:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560687.441951:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560687.441953:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560687.446404:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560687.446418:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdfb64dc/0xe34191b0567402e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787560687.446885:0:14998:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1787560687.446991:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14335:x1874392815604608:12345-0@lo:5:osp-pre-1-0.0 Request processed in 108156us (126685us total) trans 0 rc 0/0 00010000:00010000:3.0:1787560687.448110:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560687.448161:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560687.448238:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14335:1874392815604608:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787560687.448255:0:14335:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787560687.448302:0:14335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14335:1874392815604736:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787560687.448348:0:14335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560687.448435:0:14335:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d986784f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560687.448452:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815604736 00000100:00100000:0.0:1787560687.448458:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815604736 00000100:00100000:0.0:1787560687.451198:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560687.451220:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14335:x1874392815604736:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787560687.451274:0:14998:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787560687.456501:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14335:x1874392815604736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5284us (8145us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787560687.456514:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560687.456722:0:14335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14335:1874392815604736:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787560687.456738:0:14335:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:02000400:1.0:1787560688.195986:0:16068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg156-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787560688.275566:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560688.335342:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560688.335365:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9bb0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815604864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560688.335435:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560688.335503:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815604864 00000100:00100000:2.0:1787560688.335511:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815604864 00000100:00100000:2.0:1787560688.335553:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560688.335562:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815604864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560688.335596:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560688.335641:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815604864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560688.335649:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560688.335697:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9bb0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815604864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787560689.295111:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560690.043023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560690.043064:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788344960 00000100:00100000:1.0:1787560690.043073:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788344960 00000100:00100000:1.0:1787560690.043118:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:1.0:1787560690.043126:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2341:x1874392788344960:12345-192.168.201.56@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787560690.043153:0:14303:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 22884a16-a96e-4dcb-91b8-75d054db9e6f@192.168.201.56@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:1.0:1787560690.043192:0:14303:0:(genops.c:1385:class_connect()) connect: client 22884a16-a96e-4dcb-91b8-75d054db9e6f, cookie 0xe34191b0567402ee 00000100:00080000:1.0:1787560690.043327:0:14303:0:(import.c:65:import_set_state_nolock()) ffff93d882dfe000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560690.043389:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+5:2341:x1874392788344960:12345-192.168.201.56@tcp:250:mount.lustre.0 Request processed in 262us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560690.043397:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 74 00000100:00100000:2.0:1787560690.053390:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560690.053531:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788345088 00000100:00100000:3.0:1787560690.053541:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788345088 00000100:00100000:3.0:1787560690.053603:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:3.0:1787560690.053614:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+5:13725:x1874392788345088:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787560690.053639:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560690.053657:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21da800/0xe34191b0567402f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9269f expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560690.053688:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21da800/0xe34191b0567402f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9269f expref: 6 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560690.053713:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21da800/0xe34191b0567402f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9269f expref: 6 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560690.053723:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21da800, rc 0) 00000100:00100000:3.0:1787560690.053778:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+6:13725:x1874392788345088:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 166us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560690.053786:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 75 00000100:00100000:2.0:1787560690.062691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560690.062795:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788345216 00000100:00100000:0.0:1787560690.062806:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788345216 00000100:00100000:0.0:1787560690.063151:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:0.0:1787560690.063162:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+6:13725:x1874392788345216:12345-192.168.201.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787560690.063435:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+6:13725:x1874392788345216:12345-192.168.201.56@tcp:501:mount.lustre.0 Request processed in 274us (751us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560690.063444:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 76 00000100:00100000:3.0:1787560690.073915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560690.074017:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788345344 00000100:00100000:1.0:1787560690.074027:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788345344 00000100:00100000:1.0:1787560690.074080:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 77 00000100:00100000:1.0:1787560690.074090:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+6:13725:x1874392788345344:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787560690.074113:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560690.074131:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4260000/0xe34191b0567402fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf926a6 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.074162:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4260000/0xe34191b0567402fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926a6 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.074173:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4260000/0xe34191b0567402fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926a6 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.074182:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260000, rc 0) 00000100:00100000:1.0:1787560690.074238:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+7:13725:x1874392788345344:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 150us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560690.074245:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 77 00000100:00100000:1.0:1787560690.081804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560690.082019:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788345472 00000100:00100000:0.0:1787560690.082030:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788345472 00000100:00100000:0.0:1787560690.082079:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:0.0:1787560690.082089:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+7:13725:x1874392788345472:12345-192.168.201.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787560690.082387:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+8:13725:x1874392788345472:12345-192.168.201.56@tcp:501:mount.lustre.0 Request processed in 297us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560690.082397:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 78 00000100:00100000:0.0:1787560690.090288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560690.090397:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788345600 00000100:00100000:3.0:1787560690.090407:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788345600 00000100:00100000:3.0:1787560690.090498:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00100000:3.0:1787560690.090510:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+8:13725:x1874392788345600:12345-192.168.201.56@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787560690.090842:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+8:13725:x1874392788345600:12345-192.168.201.56@tcp:503:mount.lustre.0 Request processed in 326us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560690.090901:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 79 00000100:00100000:3.0:1787560690.094542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560690.094661:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788345728 00000100:00100000:1.0:1787560690.094683:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788345728 00000100:00100000:1.0:1787560690.094815:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00100000:1.0:1787560690.094826:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+8:13744:x1874392788345728:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787560690.095151:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+8:13744:x1874392788345728:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 327us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560690.095160:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 80 00000100:00100000:1.0:1787560690.109735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560690.110018:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788345856 00000100:00100000:3.0:1787560690.110029:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788345856 00000100:00100000:3.0:1787560690.110083:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 81 00000100:00100000:3.0:1787560690.110093:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+8:13744:x1874392788345856:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560690.110415:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+8:13744:x1874392788345856:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 322us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560690.110424:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 81 00000100:00100000:2.0:1787560690.112617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560690.112748:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788345984 00000100:00100000:1.0:1787560690.112757:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788345984 00000100:00100000:1.0:1787560690.112807:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:1.0:1787560690.112818:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+8:13725:x1874392788345984:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787560690.112834:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560690.112887:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4261800/0xe34191b056740303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf926d0 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.112914:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4261800/0xe34191b056740303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d0 expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.112926:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4261800/0xe34191b056740303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d0 expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.112936:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261800, rc 0) 00000100:00100000:1.0:1787560690.113007:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+9:13725:x1874392788345984:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 180us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560690.113014:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 82 00000100:00100000:1.0:1787560690.126620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560690.126683:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788346112 00000100:00100000:0.0:1787560690.126691:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788346112 00000100:00100000:0.0:1787560690.126748:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:0.0:1787560690.126758:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+9:13725:x1874392788346112:12345-192.168.201.56@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787560690.126784:0:14305:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787560690.126810:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787560690.126814:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787560690.126817:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787560690.126820:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787560690.129632:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+9:13725:x1874392788346112:12345-192.168.201.56@tcp:256:mount.lustre.0 Request processed in 2865us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560690.129659:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 83 00000100:00100000:2.0:1787560690.136569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560690.136838:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788346240 00000100:00100000:3.0:1787560690.136873:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788346240 00000100:00100000:3.0:1787560690.136922:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:3.0:1787560690.136933:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+9:13725:x1874392788346240:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787560690.136951:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560690.136976:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21db800/0xe34191b05674030a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf926d7 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560690.137001:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21db800/0xe34191b05674030a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d7 expref: 10 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560690.137013:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21db800/0xe34191b05674030a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d7 expref: 10 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560690.137022:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db800, rc 0) 00000100:00100000:3.0:1787560690.137078:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+10:13725:x1874392788346240:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 147us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560690.137085:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 84 00000100:00100000:1.0:1787560690.144379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560690.144583:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788346368 00000100:00100000:0.0:1787560690.144593:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788346368 00000100:00100000:0.0:1787560690.144694:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:0.0:1787560690.144717:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+10:13725:x1874392788346368:12345-192.168.201.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787560690.145055:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+10:13725:x1874392788346368:12345-192.168.201.56@tcp:501:mount.lustre.0 Request processed in 340us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560690.145064:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 85 00000100:00100000:2.0:1787560690.148470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560690.148561:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788346496 00000100:00100000:3.0:1787560690.148571:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788346496 00000100:00100000:3.0:1787560690.148628:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:3.0:1787560690.148638:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+10:13725:x1874392788346496:12345-192.168.201.56@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787560690.148937:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+10:13725:x1874392788346496:12345-192.168.201.56@tcp:503:mount.lustre.0 Request processed in 299us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560690.148951:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 86 00000100:00100000:2.0:1787560690.157056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560690.157615:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788346624 00000100:00100000:0.0:1787560690.157628:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788346624 00000100:00100000:0.0:1787560690.157680:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00100000:0.0:1787560690.157690:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+10:13748:x1874392788346624:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560690.158104:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+10:13748:x1874392788346624:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 415us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560690.158111:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 87 00000100:00100000:2.0:1787560690.165948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560690.169283:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788346752 00000100:00100000:1.0:1787560690.169298:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788346752 00000100:00100000:1.0:1787560690.169357:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 88 00000100:00100000:1.0:1787560690.169381:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+10:13748:x1874392788346752:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787560690.169643:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+10:13748:x1874392788346752:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 262us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560690.169650:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 88 00000100:00100000:2.0:1787560690.184060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560690.184158:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788346880 00000100:00100000:3.0:1787560690.184175:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788346880 00000100:00100000:3.0:1787560690.184300:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:3.0:1787560690.184316:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2341:x1874392788346880:12345-192.168.201.56@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787560690.184366:0:14344:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 936664d3-5703-46ce-869f-e8a83298bb2c@192.168.201.56@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:3.0:1787560690.184436:0:14344:0:(genops.c:1385:class_connect()) connect: client 936664d3-5703-46ce-869f-e8a83298bb2c, cookie 0xe34191b056740311 00000004:00100000:3.0:1787560690.184476:0:14344:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787560690.184483:0:14344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787560690.214099:0:14344:0:(import.c:65:import_set_state_nolock()) ffff93d99859f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560690.214224:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+6:2341:x1874392788346880:12345-192.168.201.56@tcp:38:mount.lustre.0 Request processed in 29909us (30171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560690.214239:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:2.0:1787560690.216976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560690.217584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560690.217896:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788347008 00000100:00100000:3.0:1787560690.217910:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788347008 00000100:00080000:2.0:1787560690.218165:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560690.218245:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788347136 00000100:00100000:3.0:1787560690.218250:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788347136 00000100:00100000:3.0:1787560690.218291:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:3.0:1787560690.218303:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+7:0:x1874392788347008:12345-192.168.201.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787560690.218364:0:14312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787560690.218481:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+7:0:x1874392788347008:12345-192.168.201.56@tcp:41:mount.lustre.0 Request processed in 179us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560690.218490:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:3.0:1787560690.218512:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:3.0:1787560690.218520:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+6:13725:x1874392788347136:12345-192.168.201.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787560690.218550:0:14312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787560690.218574:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+6:13725:x1874392788347136:12345-192.168.201.56@tcp:41:mount.lustre.0 Request processed in 55us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560690.218581:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:2.0:1787560690.222616:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560690.222890:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788347264 00000100:00100000:3.0:1787560690.222905:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788347264 00000100:00100000:3.0:1787560690.222991:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:3.0:1787560690.223014:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+6:13725:x1874392788347264:12345-192.168.201.56@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787560690.223138:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+6:13725:x1874392788347264:12345-192.168.201.56@tcp:40:mount.lustre.0 Request processed in 136us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560690.223147:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:0.0:1787560690.227796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560690.228251:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788347648 00000100:00100000:3.0:1787560690.228265:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788347648 00000100:00100000:3.0:1787560690.228384:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:3.0:1787560690.228399:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+6:13725:x1874392788347648:12345-192.168.201.56@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787560690.231513:0:14313:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3004us 00000100:00100000:2.0:1787560690.232273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560690.232314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560690.232347:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788347392 00000100:00100000:2.0:1787560690.232359:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788347392 00000100:00100000:2.0:1787560690.232408:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788347520 00000100:00100000:2.0:1787560690.232411:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788347520 00000100:00100000:2.0:1787560690.232428:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:2.0:1787560690.232439:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1874392788347392:12345-192.168.201.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787560690.232478:0:14996:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 936664d3-5703-46ce-869f-e8a83298bb2c@192.168.201.56@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1787560690.232516:0:14996:0:(genops.c:1385:class_connect()) connect: client 936664d3-5703-46ce-869f-e8a83298bb2c, cookie 0xe34191b056740318 00002000:00100000:2.0:1787560690.232532:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 936664d3-5703-46ce-869f-e8a83298bb2c/ffff93d9b38e7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787560690.232546:0:14996:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787560690.233451:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787560690.233559:0:14996:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560690.235784:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+6:2341:x1874392788347392:12345-192.168.201.56@tcp:8:mount.lustre.0 Request processed in 3333us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560690.235801:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:2.0:1787560690.235844:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:2.0:1787560690.235874:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2341:x1874392788347520:12345-192.168.201.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787560690.235911:0:14996:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 936664d3-5703-46ce-869f-e8a83298bb2c@192.168.201.56@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1787560690.235946:0:14996:0:(genops.c:1385:class_connect()) connect: client 936664d3-5703-46ce-869f-e8a83298bb2c, cookie 0xe34191b05674031f 00002000:00100000:2.0:1787560690.235961:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 936664d3-5703-46ce-869f-e8a83298bb2c/ffff93d9b38e0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787560690.235992:0:14996:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787560690.236208:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787560690.236250:0:14996:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560690.236319:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+6:2341:x1874392788347520:12345-192.168.201.56@tcp:8:mount.lustre.0 Request processed in 445us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560690.236327:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000004:00200000:3.0:1787560690.267335:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787560690.267557:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+6:13725:x1874392788347648:12345-192.168.201.56@tcp:33:mount.lustre.0 Request processed in 39153us (39768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560690.267571:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00010000:00010000:1.0:1787560690.319300:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560690.516534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560690.516652:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788347776 00000100:00100000:1.0:1787560690.516662:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788347776 00000100:00100000:1.0:1787560690.516743:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:1.0:1787560690.516755:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+6:13769:x1874392788347776:12345-192.168.201.56@tcp:101:mkdir.0 00010000:00010000:1.0:1787560690.516775:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560690.516829:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b056740326 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92701 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.516925:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674032d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.516939:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674032d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.516966:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674032d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560690.517183:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787560690.517188:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560690.517288:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674032d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.517317:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b056740326 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92701 expref: 8 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.517351:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674032d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92701 expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560690.517361:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27300) 00010000:00010000:1.0:1787560690.517364:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787560690.517368:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261a00, rc 0) 00000100:00100000:1.0:1787560690.517435:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+7:13769:x1874392788347776:12345-192.168.201.56@tcp:101:mkdir.0 Request processed in 683us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560690.517442:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00010000:00010000:0.0:1787560691.344580:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560692.367395:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560692.431199:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815604992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560692.431298:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560692.431700:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815604992 00000100:00100000:3.0:1787560692.431709:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815604992 00000100:00100000:3.0:1787560692.431777:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560692.431790:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874392815604992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560692.431822:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560692.431913:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874392815604992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560692.431921:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560692.431970:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815604992:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787560692.432112:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560692.434310:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815605376:0@lo:400:kworker.0 00000100:00100000:3.0:1787560692.434389:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560692.434430:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560692.434437:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815605504:0@lo:400:kworker.0 00000100:00100000:3.0:1787560692.434460:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560692.434488:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815605376 00000100:00100000:3.0:1787560692.434495:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815605376 00000100:00100000:3.0:1787560692.434542:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815605504 00000100:00100000:3.0:1787560692.434546:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815605504 00000100:00100000:3.0:1787560692.434575:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560692.434584:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815605376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560692.434635:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874392815605376:12345-0@lo:400:kworker.0 Request processed in 52us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560692.434977:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560692.434999:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560692.435008:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815605504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560692.435042:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815605504:12345-0@lo:400:kworker.0 Request processed in 37us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560692.435048:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787560692.435091:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815605504:0@lo:400:kworker.0 00000100:00100000:3.0:1787560692.435102:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874392815605376:0@lo:400:kworker.0 00000100:00080000:3.0:1787560692.435168:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560692.435189:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815605248:0@lo:400:kworker.0 00000100:00100000:3.0:1787560692.435234:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560692.435256:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787560692.435263:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449b2653-031b-4a00-838c-f2377a91f8ff:3314:1874392815605120:0@lo:400:kworker.0 00000100:00100000:3.0:1787560692.435291:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560692.435317:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815605632:0@lo:400:kworker.0 00000100:00100000:3.0:1787560692.435481:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560692.435508:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815605120 00000100:00100000:3.0:1787560692.435513:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815605120 00000100:00100000:3.0:1787560692.435542:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787560692.435549:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+19:3314:x1874392815605120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560692.435583:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+19:3314:x1874392815605120:12345-0@lo:400:kworker.0 Request processed in 35us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560692.435590:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787560692.435622:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449b2653-031b-4a00-838c-f2377a91f8ff:3314:1874392815605120:0@lo:400:kworker.0 00000100:00100000:3.0:1787560692.435638:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815605632 00000100:00100000:3.0:1787560692.435642:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815605632 00000100:00100000:3.0:1787560692.435681:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787560692.435688:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815605632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560692.436983:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815605248 00000100:00100000:2.0:1787560692.436994:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815605248 00000100:00100000:2.0:1787560692.437051:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560692.437061:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815605248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560692.437129:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874392815605248:12345-0@lo:400:kworker.0 Request processed in 70us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560692.437135:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560692.437181:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874392815605248:0@lo:400:kworker.0 00000100:00080000:2.0:1787560692.437221:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560692.437237:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560692.437380:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874392815605632:12345-0@lo:400:kworker.0 Request processed in 1692us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560692.437388:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560692.438488:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874392815605632:0@lo:400:kworker.0 00000001:00080000:0.0:1787560692.510825:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787560692.510914:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 936664d3-5703-46ce-869f-e8a83298bb2c 00000001:00100000:0.0:1787560692.510923:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787560692.831282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560692.832197:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788347904 00000100:00100000:3.0:1787560692.832209:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788347904 00000100:00100000:3.0:1787560692.832305:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:3.0:1787560692.832331:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+7:13821:x1874392788347904:12345-192.168.201.56@tcp:41:lfs.0 00000004:00000024:3.0:1787560692.832377:0:14311:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1787560692.833202:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560692.833298:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+7:13821:x1874392788347904:12345-192.168.201.56@tcp:41:lfs.0 Request processed in 966us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560692.833308:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:2.0:1787560692.845120:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560692.845269:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788348032 00000100:00100000:3.0:1787560692.845280:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788348032 00000100:00100000:3.0:1787560692.845394:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:3.0:1787560692.845405:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:936664d3-5703-46ce-869f-e8a83298bb2c+6:13821:x1874392788348032:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:3.0:1787560692.845460:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560692.845555:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:936664d3-5703-46ce-869f-e8a83298bb2c+6:13821:x1874392788348032:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 145us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560692.845563:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00080000:2.0:1787560692.847316:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560692.851526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560692.851714:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788348160 00000100:00100000:3.0:1787560692.851726:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788348160 00000100:00100000:3.0:1787560692.851806:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:3.0:1787560692.851817:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:936664d3-5703-46ce-869f-e8a83298bb2c+5:13821:x1874392788348160:12345-192.168.201.56@tcp:13:lfs.0 00002000:00000024:3.0:1787560692.851872:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787560692.852270:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560692.852605:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:936664d3-5703-46ce-869f-e8a83298bb2c+5:13821:x1874392788348160:12345-192.168.201.56@tcp:13:lfs.0 Request processed in 786us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560692.852615:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:1.0:1787560693.104318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560693.104410:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788348288 00000100:00100000:0.0:1787560693.104420:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788348288 00000100:00100000:0.0:1787560693.104490:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00100000:0.0:1787560693.104499:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+10:13854:x1874392788348288:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787560693.104516:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560693.104550:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9812ebe00/0xe34191b056740334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92708 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560693.104577:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9812ebe00/0xe34191b056740334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92708 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560693.104588:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9812ebe00/0xe34191b056740334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92708 expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560693.104597:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ebe00, rc 0) 00000100:00100000:0.0:1787560693.105199:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13854:x1874392788348288:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 183us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560693.105208:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 90 00000100:00100000:2.0:1787560693.109127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560693.109333:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788348416 00000100:00100000:1.0:1787560693.109344:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788348416 00000100:00100000:1.0:1787560693.109460:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 91 00000100:00100000:1.0:1787560693.109471:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13854:x1874392788348416:12345-192.168.201.56@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787560693.110085:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13854:x1874392788348416:12345-192.168.201.56@tcp:501:mount.lustre.0 Request processed in 613us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560693.110094:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 91 00000100:00100000:2.0:1787560693.115373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560693.115463:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788348544 00000100:00100000:0.0:1787560693.115473:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788348544 00000100:00100000:0.0:1787560693.115531:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:0.0:1787560693.115541:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9ba37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13854:x1874392788348544:12345-192.168.201.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787560693.115779:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9ba37d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13854:x1874392788348544:12345-192.168.201.56@tcp:503:mount.lustre.0 Request processed in 238us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560693.115787:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 92 00000100:00100000:0.0:1787560693.122389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560693.122781:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788348672 00000100:00100000:2.0:1787560693.122791:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788348672 00000100:00100000:1.0:1787560693.122985:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00100000:1.0:1787560693.122998:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13859:x1874392788348672:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787560693.123388:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13859:x1874392788348672:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 391us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560693.123407:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 93 00000100:00100000:2.0:1787560693.162452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560693.162549:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788348800 00000100:00100000:3.0:1787560693.162558:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788348800 00000100:00100000:3.0:1787560693.162614:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:3.0:1787560693.162625:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13859:x1874392788348800:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560693.163001:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3764850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13859:x1874392788348800:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 378us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560693.163011:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 94 00000100:00100000:2.0:1787560693.180055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560693.180399:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788348928 00000100:00100000:1.0:1787560693.180409:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788348928 00000100:00100000:1.0:1787560693.180463:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 95 00000100:00100000:1.0:1787560693.180473:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13854:x1874392788348928:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787560693.180489:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560693.180505:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4260600/0xe34191b05674033b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92732 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560693.180534:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4260600/0xe34191b05674033b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92732 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560693.180546:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4260600/0xe34191b05674033b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92732 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560693.180556:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260600, rc 0) 00000100:00100000:1.0:1787560693.180610:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+12:13854:x1874392788348928:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 139us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560693.180617:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 95 00000100:00100000:0.0:1787560693.196909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560693.199272:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788349056 00000100:00100000:2.0:1787560693.199286:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788349056 00000100:00100000:2.0:1787560693.199401:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 96 00000100:00100000:2.0:1787560693.199413:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+12:13854:x1874392788349056:12345-192.168.201.56@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787560693.199440:0:14305:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787560693.199462:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787560693.199467:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787560693.199470:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787560693.199472:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787560693.204262:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+12:13854:x1874392788349056:12345-192.168.201.56@tcp:256:mount.lustre.0 Request processed in 4831us (7395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560693.204290:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 96 00000100:00100000:3.0:1787560693.211740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560693.213334:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788349184 00000100:00100000:0.0:1787560693.213349:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788349184 00000100:00100000:0.0:1787560693.213416:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00100000:0.0:1787560693.213427:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+12:13854:x1874392788349184:12345-192.168.201.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787560693.213444:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560693.213461:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9812eb600/0xe34191b056740342 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92739 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560693.213489:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9812eb600/0xe34191b056740342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92739 expref: 13 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560693.213500:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9812eb600/0xe34191b056740342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92739 expref: 13 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560693.213509:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb600, rc 0) 00000100:00100000:0.0:1787560693.213578:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13854:x1874392788349184:12345-192.168.201.56@tcp:101:mount.lustre.0 Request processed in 153us (1847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560693.213586:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 97 00000100:00100000:2.0:1787560693.216708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560693.222002:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788349312 00000100:00100000:0.0:1787560693.222016:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788349312 00000100:00100000:0.0:1787560693.222102:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:0.0:1787560693.222114:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13854:x1874392788349312:12345-192.168.201.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787560693.222423:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13854:x1874392788349312:12345-192.168.201.56@tcp:501:mount.lustre.0 Request processed in 311us (5724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560693.222432:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 98 00000100:00100000:2.0:1787560693.227560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560693.227703:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788349440 00000100:00100000:1.0:1787560693.227714:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788349440 00000100:00100000:1.0:1787560693.227776:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:1.0:1787560693.227787:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13854:x1874392788349440:12345-192.168.201.56@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787560693.228046:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13854:x1874392788349440:12345-192.168.201.56@tcp:503:mount.lustre.0 Request processed in 259us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560693.228053:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 99 00000100:00100000:2.0:1787560693.231712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560693.231798:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788349568 00000100:00100000:3.0:1787560693.231807:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788349568 00000100:00100000:3.0:1787560693.231896:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00100000:3.0:1787560693.231913:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13864:x1874392788349568:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560693.232291:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13864:x1874392788349568:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 384us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560693.232299:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 100 00000100:00100000:2.0:1787560693.237365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560693.237455:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788349696 00000100:00100000:0.0:1787560693.237464:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788349696 00000100:00100000:0.0:1787560693.237519:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 101 00000100:00100000:0.0:1787560693.237529:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13864:x1874392788349696:12345-192.168.201.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560693.237793:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13864:x1874392788349696:12345-192.168.201.56@tcp:502:llog_process_th.0 Request processed in 264us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560693.237801:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 101 00000100:00100000:2.0:1787560693.249243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560693.249287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560693.249372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560693.249429:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788350208 00000100:00100000:3.0:1787560693.249439:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788350208 00000100:00100000:3.0:1787560693.249500:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:3.0:1787560693.249556:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+7:2345:x1874392788350208:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560693.249633:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+7:2345:x1874392788350208:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 124us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560693.249641:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:1.0:1787560693.250973:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788350336 00000100:00100000:1.0:1787560693.250983:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788350336 00000100:00100000:1.0:1787560693.251035:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788350464 00000100:00100000:1.0:1787560693.251038:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788350464 00000100:00100000:1.0:1787560693.251058:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:1.0:1787560693.251067:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+6:2345:x1874392788350336:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560693.251068:0:14997:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560693.251076:0:14997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787560693.251128:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+6:2345:x1874392788350336:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 61us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560693.251135:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:1.0:1787560693.251150:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:1.0:1787560693.251156:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+5:2345:x1874392788350464:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560693.251180:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+5:2345:x1874392788350464:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 24us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560693.251186:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:2.0:1787560693.256769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560693.256973:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788349824 00000100:00100000:0.0:1787560693.256984:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788349824 00000100:00100000:0.0:1787560693.257033:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:0.0:1787560693.257042:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2341:x1874392788349824:12345-192.168.201.56@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787560693.257071:0:14344:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a61328c9-c3e1-4e42-a91a-11289a78c799@192.168.201.56@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:0.0:1787560693.257109:0:14344:0:(genops.c:1385:class_connect()) connect: client a61328c9-c3e1-4e42-a91a-11289a78c799, cookie 0xe34191b056740349 00000004:00100000:0.0:1787560693.257142:0:14344:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787560693.257274:0:14344:0:(import.c:65:import_set_state_nolock()) ffff93d98957f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560693.257352:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bb0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61328c9-c3e1-4e42-a91a-11289a78c799+6:2341:x1874392788349824:12345-192.168.201.56@tcp:38:mount.lustre.0 Request processed in 309us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560693.257360:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:2.0:1787560693.268467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560693.268509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560693.268593:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788350080 00000100:00100000:3.0:1787560693.268603:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788350080 00000100:00100000:3.0:1787560693.268690:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788349952 00000100:00100000:3.0:1787560693.268694:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788349952 00000100:00100000:3.0:1787560693.268720:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:3.0:1787560693.268730:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+7:13854:x1874392788350080:12345-192.168.201.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787560693.268779:0:14310:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787560693.268889:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+7:13854:x1874392788350080:12345-192.168.201.56@tcp:41:mount.lustre.0 Request processed in 160us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560693.268898:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:3.0:1787560693.268928:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1787560693.268937:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+6:0:x1874392788349952:12345-192.168.201.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787560693.268948:0:14310:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787560693.268973:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+6:0:x1874392788349952:12345-192.168.201.56@tcp:41:mount.lustre.0 Request processed in 38us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560693.268980:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00080000:2.0:1787560693.269719:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560693.279441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560693.279536:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788350592 00000100:00100000:3.0:1787560693.279546:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788350592 00000100:00100000:3.0:1787560693.279609:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:3.0:1787560693.279620:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+6:13854:x1874392788350592:12345-192.168.201.56@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787560693.279720:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+6:13854:x1874392788350592:12345-192.168.201.56@tcp:40:mount.lustre.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560693.279728:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:2.0:1787560693.284478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560693.284566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560693.290381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560693.290963:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788350720 00000100:00100000:1.0:1787560693.290974:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788350720 00000100:00100000:3.0:1787560693.291098:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788350976 00000100:00100000:3.0:1787560693.291103:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788350976 00000100:00100000:1.0:1787560693.291125:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788350848 00000100:00100000:1.0:1787560693.291131:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788350848 00000100:00100000:3.0:1787560693.291151:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:3.0:1787560693.291172:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+6:13854:x1874392788350976:12345-192.168.201.56@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787560693.291175:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:2.0:1787560693.291187:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1874392788350720:12345-192.168.201.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787560693.291228:0:14997:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a61328c9-c3e1-4e42-a91a-11289a78c799@192.168.201.56@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:2.0:1787560693.291267:0:14997:0:(genops.c:1385:class_connect()) connect: client a61328c9-c3e1-4e42-a91a-11289a78c799, cookie 0xe34191b056740350 00002000:00100000:2.0:1787560693.291280:0:14997:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a61328c9-c3e1-4e42-a91a-11289a78c799/ffff93d9b38e2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787560693.291291:0:14997:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:3.0:1787560693.291459:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00002000:00080000:2.0:1787560693.291559:0:14997:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787560693.291590:0:14997:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560693.291637:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+6:2341:x1874392788350720:12345-192.168.201.56@tcp:8:mount.lustre.0 Request processed in 450us (7168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560693.291654:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+6:13854:x1874392788350976:12345-192.168.201.56@tcp:33:mount.lustre.0 Request processed in 471us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560693.291657:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:3.0:1787560693.291668:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:2.0:1787560693.291683:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:2.0:1787560693.291690:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d986a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2341:x1874392788350848:12345-192.168.201.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787560693.291705:0:14997:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a61328c9-c3e1-4e42-a91a-11289a78c799@192.168.201.56@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:2.0:1787560693.291727:0:14997:0:(genops.c:1385:class_connect()) connect: client a61328c9-c3e1-4e42-a91a-11289a78c799, cookie 0xe34191b056740357 00002000:00100000:2.0:1787560693.291733:0:14997:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a61328c9-c3e1-4e42-a91a-11289a78c799/ffff93d9b38e6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787560693.291739:0:14997:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787560693.291926:0:14997:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787560693.291942:0:14997:0:(import.c:65:import_set_state_nolock()) ffff93d9b38e3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560693.291979:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d986a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+6:2341:x1874392788350848:12345-192.168.201.56@tcp:8:mount.lustre.0 Request processed in 288us (7413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560693.291993:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00010000:00010000:0.0:1787560693.392346:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560693.459606:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560693.459629:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815605760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560693.459715:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560693.459791:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815605760 00000100:00100000:2.0:1787560693.459798:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815605760 00000100:00100000:2.0:1787560693.459838:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560693.459862:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815605760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560693.459884:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560693.459926:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815605760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560693.459933:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560693.460005:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815605760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560693.467518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560693.467832:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788351104 00000100:00100000:1.0:1787560693.467842:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788351104 00000100:00100000:1.0:1787560693.468456:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:1.0:1787560693.468467:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61328c9-c3e1-4e42-a91a-11289a78c799+6:13885:x1874392788351104:12345-192.168.201.56@tcp:101:mkdir.0 00010000:00010000:1.0:1787560693.468488:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560693.468510:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05674035e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92763 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560693.468572:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560693.468605:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560693.468617:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560693.468810:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787560693.468815:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787560693.468914:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560693.468943:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261e00/0xe34191b05674035e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92763 expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560693.469148:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92763 expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560693.469159:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27300) 00010000:00010000:1.0:1787560693.469162:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787560693.469165:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261c00, rc 0) 00000100:00100000:1.0:1787560693.469276:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61328c9-c3e1-4e42-a91a-11289a78c799+7:13885:x1874392788351104:12345-192.168.201.56@tcp:101:mkdir.0 Request processed in 811us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560693.469285:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000001:00100000:0.0:1787560693.517345:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a61328c9-c3e1-4e42-a91a-11289a78c799 00000001:00100000:0.0:1787560693.517361:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 936664d3-5703-46ce-869f-e8a83298bb2c 00010000:00010000:1.0:1787560694.416381:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560694.738102:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787560695.439262:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787560695.538218:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a61328c9-c3e1-4e42-a91a-11289a78c799 00000001:00100000:0.0:1787560695.538231:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 936664d3-5703-46ce-869f-e8a83298bb2c 00000001:02000400:0.0:1787560695.965474:0:16272:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787560696.465008:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560697.491104:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560697.555297:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815605888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560697.555373:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560697.555444:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815605888 00000100:00100000:3.0:1787560697.555452:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815605888 00000100:00100000:3.0:1787560697.555502:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787560697.555511:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815605888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560697.555547:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787560697.555603:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815605888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560697.555610:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787560697.555631:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560697.555660:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787560697.555682:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9894c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815605888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560697.556792:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815606144:0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.556873:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560697.556906:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560697.556912:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815606272:0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.556937:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560697.556969:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815606144 00000100:00100000:2.0:1787560697.556975:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815606144 00000100:00100000:2.0:1787560697.557022:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560697.557031:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815606144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.557073:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815606144:12345-0@lo:400:kworker.0 Request processed in 43us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560697.557087:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560697.557121:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815606272 00000100:00100000:2.0:1787560697.557125:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815606272 00000100:00100000:2.0:1787560697.557151:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560697.557158:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815606272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.557188:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815606272:12345-0@lo:400:kworker.0 Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560697.557194:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560697.557353:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815606272:0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.557370:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815606144:0@lo:400:kworker.0 00000100:00080000:2.0:1787560697.557396:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560697.557406:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815606400:0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.557431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560697.557451:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787560697.557457:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449b2653-031b-4a00-838c-f2377a91f8ff:3311:1874392815606016:0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.557482:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560697.557504:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d883424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815606528:0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.557522:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560697.557547:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815606400 00000100:00100000:2.0:1787560697.557551:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815606400 00000100:00100000:2.0:1787560697.557586:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815606528 00000100:00100000:2.0:1787560697.557589:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815606528 00000100:00100000:2.0:1787560697.557608:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560697.557615:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815606400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.557649:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874392815606400:12345-0@lo:400:kworker.0 Request processed in 35us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560697.557661:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560697.557673:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560697.557678:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815606528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.557704:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815606528:12345-0@lo:400:kworker.0 Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560697.557709:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787560697.557728:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560697.557744:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815606528:0@lo:400:kworker.0 00000100:00100000:2.0:1787560697.557753:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874392815606400:0@lo:400:kworker.0 00000100:00100000:1.0:1787560697.558078:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815606016 00000100:00100000:1.0:1787560697.558082:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815606016 00000100:00100000:1.0:1787560697.558114:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787560697.558121:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+19:3311:x1874392815606016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560697.558165:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+19:3311:x1874392815606016:12345-0@lo:400:kworker.0 Request processed in 44us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560697.558171:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787560697.558482:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d883426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449b2653-031b-4a00-838c-f2377a91f8ff:3311:1874392815606016:0@lo:400:kworker.0 00000001:00100000:0.0:1787560697.685469:0:7642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a61328c9-c3e1-4e42-a91a-11289a78c799 00000100:00100000:3.0:1787560698.293519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560698.293574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560698.293604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560698.293636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560698.293653:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788351232 00000100:00100000:0.0:1787560698.293663:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788351232 00000100:00100000:3.0:1787560698.293665:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788351360 00000100:00100000:3.0:1787560698.293671:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788351360 00000100:00100000:0.0:1787560698.293723:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 103 00000100:00100000:3.0:1787560698.293730:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:0.0:1787560698.293736:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:2342:x1874392788351232:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560698.293744:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+6:2343:x1874392788351360:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560698.293825:0:16185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788351616 00000100:00100000:2.0:1787560698.293829:0:16185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788351616 00000100:00100000:2.0:1787560698.293880:0:16185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788351872 00000100:00100000:2.0:1787560698.293884:0:16185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788351872 00000100:00100000:2.0:1787560698.293907:0:16185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:2.0:1787560698.293914:0:16185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936664d3-5703-46ce-869f-e8a83298bb2c+5:2343:x1874392788351616:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560698.293983:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+6:2343:x1874392788351360:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 244us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560698.293990:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:3.0:1787560698.294014:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:3.0:1787560698.294021:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9894c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2343:x1874392788351872:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560698.294660:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:2342:x1874392788351232:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 924us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560698.294667:0:16185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936664d3-5703-46ce-869f-e8a83298bb2c+5:2343:x1874392788351616:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 749us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560698.294675:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 103 00000100:00100000:2.0:1787560698.294682:0:16185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:3.0:1787560698.294788:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9894c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2343:x1874392788351872:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 766us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560698.294796:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00080000:3.0:1787560698.294818:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560698.294823:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560698.294826:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560698.302954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560698.302994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560698.303027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560698.303057:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788351488 00000100:00100000:3.0:1787560698.303066:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788351488 00000100:00100000:3.0:1787560698.303120:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788352000 00000100:00100000:3.0:1787560698.303125:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788352000 00000100:00100000:3.0:1787560698.303150:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:3.0:1787560698.303160:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936664d3-5703-46ce-869f-e8a83298bb2c+5:2342:x1874392788351488:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560698.303226:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936664d3-5703-46ce-869f-e8a83298bb2c+5:2342:x1874392788351488:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 68us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560698.303234:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:3.0:1787560698.303249:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:3.0:1787560698.303270:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2342:x1874392788352000:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560698.303294:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2342:x1874392788352000:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560698.303301:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00080000:3.0:1787560698.303320:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560698.303325:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560698.303651:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788351744 00000100:00100000:1.0:1787560698.303657:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788351744 00000100:00100000:1.0:1787560698.303703:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:1.0:1787560698.303711:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+6:2342:x1874392788351744:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:1.0:1787560698.303748:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+6:2342:x1874392788351744:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 38us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560698.303755:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00080000:3.0:1787560698.304445:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787560698.511873:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560698.591304:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815606656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560698.591367:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560698.591477:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815606656 00000100:00100000:0.0:1787560698.591486:0:15000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815606656 00000100:00100000:0.0:1787560698.591532:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560698.591541:0:15000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815606656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560698.591722:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560698.592210:0:15000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815606656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 668us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560698.592218:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560698.593312:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815606656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787560699.541665:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787560699.678434:0:16423:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6b4cad70 20000000:00000080:1.0:1787560699.678459:0:16423:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff93d88255dc00 uarg=0000000000000000 20000000:01000000:1.0:1787560699.678524:0:16423:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787560699.678544:0:16423:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787560699.678551:0:16423:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787560699.680056:0:16424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787560699.680334:0:16423:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787560699.689722:0:16423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787560699.689768:0:16423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690041:0:16423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9812ea200/0xe34191b056740063 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05674005c expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690052:0:16423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d98a711800/0xe34191b0567400b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b0567400a9 expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690059:0:16423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d990101800/0xe34191b0567401e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b0567401dd expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690095:0:16423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9c21db800/0xe34191b05674030a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d7 expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690103:0:16423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93d9812eb600/0xe34191b056740342 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92739 expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690109:0:16423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690167:0:16423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9812eb600/0xe34191b056740342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92739 expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690185:0:16423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9812eb600/0xe34191b056740342 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92739 expref: 12 pid: 14302 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560699.690202:0:16423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1874392815606784:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560699.690355:0:16423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9c21db800/0xe34191b05674030a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d7 expref: 12 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690363:0:16423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9c21db800/0xe34191b05674030a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d7 expref: 12 pid: 14302 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560699.690371:0:16423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1874392815606912:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560699.690399:0:16423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d990101800/0xe34191b0567401e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b0567401dd expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690407:0:16423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d990101800/0xe34191b0567401e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b0567401dd expref: 18 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560699.690432:0:16423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1874392815607040:0@lo:104: 00000100:00100000:1.0:1787560699.690479:0:16423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560699.690518:0:16423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d98a711800/0xe34191b0567400b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b0567400a9 expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690525:0:16423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d98a711800/0xe34191b0567400b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b0567400a9 expref: 18 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560699.690544:0:16423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1874392815607168:0@lo:104: 00000100:00100000:1.0:1787560699.690563:0:16423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560699.690588:0:16423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93d9812ea200/0xe34191b056740063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe34191b05674005c expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.690595:0:16423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93d9812ea200/0xe34191b056740063 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe34191b05674005c expref: 18 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560699.690603:0:16423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1874392815607296:0@lo:104: 00000100:00100000:1.0:1787560699.690626:0:16423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560699.690635:0:16423:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d985312e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560699.690734:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787560699.690751:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815607040 00000100:00100000:0.0:1787560699.690759:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815607040 00000100:00100000:0.0:1787560699.690817:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815607168 00000100:00100000:0.0:1787560699.690820:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815607168 00000100:00100000:0.0:1787560699.690829:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815607296 00000100:00100000:0.0:1787560699.690831:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815607296 00000100:00100000:0.0:1787560699.690872:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560699.690883:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:449b2653-031b-4a00-838c-f2377a91f8ff+5:16423:x1874392815607040:12345-0@lo:104: 00010000:00010000:0.0:1787560699.690899:0:14293:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.690977:0:14293:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787560699.690984:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:449b2653-031b-4a00-838c-f2377a91f8ff+5:16423:x1874392815607040:12345-0@lo:104: Request processed in 104us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560699.690992:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560699.691013:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560699.691019:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:449b2653-031b-4a00-838c-f2377a91f8ff+4:16423:x1874392815607168:12345-0@lo:104: 00010000:00010000:0.0:1787560699.691026:0:14293:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691057:0:14293:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787560699.691062:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:449b2653-031b-4a00-838c-f2377a91f8ff+4:16423:x1874392815607168:12345-0@lo:104: Request processed in 45us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560699.691067:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560699.691078:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560699.691084:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3876450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:449b2653-031b-4a00-838c-f2377a91f8ff+3:16423:x1874392815607296:12345-0@lo:104: 00010000:00010000:0.0:1787560699.691091:0:14293:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691115:0:14293:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787560699.691120:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3876450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:449b2653-031b-4a00-838c-f2377a91f8ff+3:16423:x1874392815607296:12345-0@lo:104: Request processed in 37us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560699.691125:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787560699.691164:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787560699.691171:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691178:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710a00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560699.691190:0:14298:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691199:0:14298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560699.691206:0:14298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560699.691212:0:14298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787560699.691247:0:14298:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691254:0:14298:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560699.691279:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691286:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d98a710a00/0xe34191b0567401dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b0567401e4 expref: -99 pid: 15711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691308:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560699.691312:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691319:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260a00 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560699.691322:0:14298:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691328:0:14298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560699.691344:0:14298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560699.691350:0:14298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787560699.691362:0:14298:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691367:0:14298:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560699.691383:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691390:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9b4260a00/0xe34191b0567400a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b0567400b0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691400:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560699.691403:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691409:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260200 already unused, calling callback (ffffffffc1d14c20) 10000000:00010000:0.0:1787560699.691412:0:14298:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691419:0:14298:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560699.691425:0:14298:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560699.691429:0:14298:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787560699.691446:0:14298:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691452:0:14298:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560699.691458:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691464:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.156@tcp lock: ffff93d9b4260200/0xe34191b05674005c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe34191b056740063 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691478:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560699.691480:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560699.691481:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560699.691488:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560699.691509:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449b2653-031b-4a00-838c-f2377a91f8ff:3314:1874392815607424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560699.691557:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560699.691598:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449b2653-031b-4a00-838c-f2377a91f8ff:3311:1874392815607552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560699.691624:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560699.691642:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560699.691647:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449b2653-031b-4a00-838c-f2377a91f8ff:3311:1874392815607680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560699.691672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560699.691707:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815607424 00000100:00100000:0.0:1787560699.691713:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815607424 00010000:00010000:0.0:1787560699.691735:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d990101800/0xe34191b0567401e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b0567401dd expref: 19 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560699.691752:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815607552 00000100:00100000:0.0:1787560699.691755:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815607552 00010000:00010000:0.0:1787560699.691765:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d98a711800/0xe34191b0567400b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b0567400a9 expref: 20 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560699.691788:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815607680 00000100:00100000:0.0:1787560699.691792:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815607680 00010000:00010000:0.0:1787560699.691803:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9812ea200/0xe34191b056740063 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05674005c expref: 21 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560699.691814:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560699.691820:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449b2653-031b-4a00-838c-f2377a91f8ff+21:3314:x1874392815607424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560699.691831:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560699.691836:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d990101800/0xe34191b0567401e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b0567401dd expref: 21 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691871:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d990101800/0xe34191b0567401e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b0567401dd expref: 21 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691892:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560699.691920:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449b2653-031b-4a00-838c-f2377a91f8ff+21:3314:x1874392815607424:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560699.691927:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560699.691941:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560699.691947:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449b2653-031b-4a00-838c-f2377a91f8ff+20:3311:x1874392815607552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560699.691954:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560699.691957:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d98a711800/0xe34191b0567400b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b0567400a9 expref: 20 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691965:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d98a711800/0xe34191b0567400b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b0567400a9 expref: 20 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.691974:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560699.692004:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449b2653-031b-4a00-838c-f2377a91f8ff+20:3311:x1874392815607552:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560699.692010:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560699.692022:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560699.692028:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3883050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449b2653-031b-4a00-838c-f2377a91f8ff+19:3311:x1874392815607680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560699.692035:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560699.692039:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9812ea200/0xe34191b056740063 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe34191b05674005c expref: 19 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.692047:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9812ea200/0xe34191b056740063 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe34191b05674005c expref: 19 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560699.692057:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560699.692076:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3883050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:449b2653-031b-4a00-838c-f2377a91f8ff+19:3311:x1874392815607680:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560699.692082:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560699.692146:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449b2653-031b-4a00-838c-f2377a91f8ff:3314:1874392815607424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560699.692171:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449b2653-031b-4a00-838c-f2377a91f8ff:3311:1874392815607680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560699.692178:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:449b2653-031b-4a00-838c-f2377a91f8ff:3311:1874392815607552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560699.692363:0:16423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d990101800/0xe34191b0567401e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b0567401dd expref: 18 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560699.692376:0:16423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1874392815607040:0@lo:104: 00010000:00010000:1.0:1787560699.692383:0:16423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d98a711800/0xe34191b0567400b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b0567400a9 expref: 17 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560699.692391:0:16423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1874392815607168:0@lo:104: 00010000:00010000:1.0:1787560699.692400:0:16423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9812ea200/0xe34191b056740063 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe34191b05674005c expref: 16 pid: 14303 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560699.692421:0:16423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1874392815607296:0@lo:104: 00000100:00100000:0.0:1787560699.697774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560699.697821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560699.697973:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788352128 00000100:00100000:3.0:1787560699.697985:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788352128 00010000:00010000:3.0:1787560699.698034:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9812eb600/0xe34191b056740342 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92739 expref: 13 pid: 14302 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560699.698068:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788352256 00000100:00100000:3.0:1787560699.698071:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788352256 00010000:00010000:3.0:1787560699.698083:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93d9c21db800/0xe34191b05674030a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d7 expref: 14 pid: 14302 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560699.698100:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:3.0:1787560699.698111:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22884a16-a96e-4dcb-91b8-75d054db9e6f+14:2343:x1874392788352128:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560699.698129:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560699.698135:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9812eb600/0xe34191b056740342 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92739 expref: 14 pid: 14302 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698149:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9812eb600/0xe34191b056740342 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92739 expref: 14 pid: 14302 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698175:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560699.698245:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22884a16-a96e-4dcb-91b8-75d054db9e6f+14:2343:x1874392788352128:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 135us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560699.698254:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:3.0:1787560699.698273:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:3.0:1787560699.698279:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:2343:x1874392788352256:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560699.698286:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560699.698291:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93d9c21db800/0xe34191b05674030a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d7 expref: 13 pid: 14302 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698314:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93d9c21db800/0xe34191b05674030a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d7 expref: 13 pid: 14302 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698328:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698338:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698355:0:14296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698363:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698370:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698376:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698383:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261000 already unused, calling callback (ffffffffc170c230) 00010000:00010000:3.0:1787560699.698388:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698398:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698408:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560699.698431:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560699.698453:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:2343:x1874392788352256:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 174us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560699.698460:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00010000:00010000:1.0:1787560699.699235:0:16423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9812eb600/0xe34191b056740342 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92739 expref: 12 pid: 14302 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560699.699258:0:16423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1874392815606784:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560699.699299:0:16423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9c21db800/0xe34191b05674030a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf926d7 expref: 11 pid: 14302 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560699.699308:0:16423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16423:1874392815606912:192.168.201.56@tcp:104: 00010000:00010000:1.0:1787560699.699350:0:16423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.699361:0:16423:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.699368:0:16423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560699.699374:0:16423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93d9b4261000/0xe34191b05674036c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560700.567050:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560701.561114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560701.561339:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788352384 00000100:00100000:1.0:1787560701.561352:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788352384 00000100:00100000:1.0:1787560701.561654:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:1.0:1787560701.561668:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+11:13739:x1874392788352384:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560701.561690:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560701.561716:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9b4261e00/0xe34191b056740373 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9276a expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560701.561763:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9b4261e00/0xe34191b056740373 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9276a expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560701.561777:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9b4261e00/0xe34191b056740373 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9276a expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560701.561789:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261e00, rc 0) 00000100:00100000:1.0:1787560701.562476:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+12:13739:x1874392788352384:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 807us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560701.562486:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 104 00000100:00100000:3.0:1787560701.570153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560701.570226:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788352512 00000100:00100000:1.0:1787560701.570237:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788352512 00000100:00100000:1.0:1787560701.570298:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 105 00000100:00100000:1.0:1787560701.570306:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+12:13739:x1874392788352512:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560701.570775:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+12:13739:x1874392788352512:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 467us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560701.570785:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 105 00000100:00100000:2.0:1787560701.579124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560701.579194:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788352640 00000100:00100000:2.0:1787560701.579208:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788352640 00000100:00100000:2.0:1787560701.579271:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 106 00000100:00100000:2.0:1787560701.579283:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+12:13739:x1874392788352640:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560701.579590:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22884a16-a96e-4dcb-91b8-75d054db9e6f+12:13739:x1874392788352640:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 Request processed in 308us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560701.579600:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 106 10000000:01000000:0.0:1787560701.583065:0:14307:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560701.583076:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d881854800 from 10 10000000:01000000:0.0:1787560701.583084:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560701.583147:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eb600/0xe34191b05674037a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.583174:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9812eb600/0xe34191b05674037a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.583191:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9812eb600/0xe34191b05674037a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560701.583225:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815607808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.583317:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560701.583391:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987d46240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560701.583541:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815607808 00000100:00100000:3.0:1787560701.583552:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815607808 00000100:00100000:3.0:1787560701.583617:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787560701.583629:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+16:14307:x1874392815607808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560701.583645:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560701.583661:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21dbe00/0xe34191b056740381 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05674037a expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560701.583692:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21dbe00/0xe34191b056740381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05674037a expref: 17 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560701.583705:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21dbe00/0xe34191b056740381 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05674037a expref: 17 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560701.583716:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21dbe00, rc 0) 00000100:00100000:3.0:1787560701.583772:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+17:14307:x1874392815607808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560701.583780:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787560701.583952:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815607808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560701.583969:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9812eb600/0xe34191b05674037a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740381 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.583980:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9812eb600/0xe34191b05674037a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b056740381 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560701.584052:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815607936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.584085:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560701.584116:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987d46240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560701.584172:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815607936 00000100:00100000:3.0:1787560701.584178:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815607936 00000100:00100000:3.0:1787560701.584209:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787560701.584342:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+17:14307:x1874392815607936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560701.584800:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+17:14307:x1874392815607936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 459us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560701.584810:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787560701.585642:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815607936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.585700:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.585755:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560701.585792:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987d46240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560701.585814:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815608064 00000100:00100000:0.0:1787560701.585820:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815608064 00000100:00100000:0.0:1787560701.585902:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787560701.585912:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+17:14307:x1874392815608064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.586125:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+17:14307:x1874392815608064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560701.586132:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787560701.586183:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787560701.588090:0:16515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:2.0:1787560701.594004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560701.594067:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788352768 00000100:00100000:2.0:1787560701.594081:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788352768 00000100:00100000:2.0:1787560701.594143:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 110 00000100:00100000:2.0:1787560701.594155:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+12:13739:x1874392788352768:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560701.594179:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560701.594204:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d98a710a00/0xe34191b056740388 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92771 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560701.594244:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d98a710a00/0xe34191b056740388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92771 expref: 13 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560701.594259:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d98a710a00/0xe34191b056740388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92771 expref: 13 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560701.594271:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710a00, rc 0) 00000100:00100000:2.0:1787560701.594340:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13739:x1874392788352768:12345-192.168.201.56@tcp:101:ll_cfg_requeue.0 Request processed in 187us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560701.594348:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 110 00010000:00010000:0.0:1787560701.596634:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787560701.596659:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787560701.596699:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560701.596714:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eb600/0xe34191b05674037a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740381 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.596729:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812eb600/0xe34191b05674037a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740381 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560701.596743:0:14307:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560701.596747:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9bb20f000 from 10 10000000:01000000:0.0:1787560701.596750:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560701.596803:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812ea200/0xe34191b05674038f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.596813:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9812ea200/0xe34191b05674038f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.596825:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9812ea200/0xe34191b05674038f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560701.596892:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.596984:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560701.597051:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987d46240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560701.597077:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815608192 00000100:00100000:0.0:1787560701.597086:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815608192 00000100:00100000:0.0:1787560701.597147:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787560701.597157:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+17:14307:x1874392815608192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560701.597172:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560701.597188:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9812eaa00/0xe34191b056740396 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05674038f expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.597217:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9812eaa00/0xe34191b056740396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05674038f expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.597230:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9812eaa00/0xe34191b056740396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05674038f expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.597240:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eaa00, rc 0) 00000100:00100000:0.0:1787560701.597284:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+18:14307:x1874392815608192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560701.597292:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787560701.597351:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560701.597366:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9812ea200/0xe34191b05674038f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740396 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.597376:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9812ea200/0xe34191b05674038f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b056740396 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560701.597434:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.597460:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560701.597485:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987d46240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560701.597516:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815608320 00000100:00100000:0.0:1787560701.597521:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815608320 00000100:00100000:0.0:1787560701.597546:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787560701.597553:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+18:14307:x1874392815608320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.597883:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+18:14307:x1874392815608320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 330us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560701.597891:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787560701.597922:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.597951:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.597995:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560701.598019:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987d46240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560701.598032:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815608448 00000100:00100000:0.0:1787560701.598037:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815608448 00000100:00100000:0.0:1787560701.598061:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787560701.598069:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+18:14307:x1874392815608448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.598240:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+18:14307:x1874392815608448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560701.598248:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787560701.598286:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787560701.600087:0:16516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787560701.603151:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787560701.603200:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560701.603217:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812ea200/0xe34191b05674038f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740396 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.603233:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812ea200/0xe34191b05674038f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b056740396 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560701.603255:0:14307:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560701.603259:0:14307:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff93d9bad52800 from 10 10000000:01000000:0.0:1787560701.603262:0:14307:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560701.603311:0:14307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eb800/0xe34191b05674039d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.603320:0:14307:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.156@tcp lock: ffff93d9812eb800/0xe34191b05674039d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.603334:0:14307:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.156@tcp lock: ffff93d9812eb800/0xe34191b05674039d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560701.603367:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.604946:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560701.605020:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987d46240 going to sleep for 11 seconds 00000100:00100000:3.0:1787560701.605150:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815608576 00000100:00100000:3.0:1787560701.605161:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815608576 00000100:00100000:3.0:1787560701.605228:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787560701.605241:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+18:14307:x1874392815608576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560701.605262:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560701.605282:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93d9c21da000/0xe34191b0567403a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe34191b05674039d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560701.605314:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93d9c21da000/0xe34191b0567403a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe34191b05674039d expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560701.605326:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93d9c21da000/0xe34191b0567403a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe34191b05674039d expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560701.605337:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21da000, rc 0) 00000100:00100000:3.0:1787560701.605388:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+19:14307:x1874392815608576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560701.605409:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787560701.605475:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560701.605616:0:14307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.156@tcp lock: ffff93d9812eb800/0xe34191b05674039d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567403a4 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560701.605630:0:14307:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.156@tcp lock: ffff93d9812eb800/0xe34191b05674039d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe34191b0567403a4 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560701.605728:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560701.606030:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560701.606058:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560701.606074:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815608704 00000100:00100000:3.0:1787560701.606079:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815608704 00000100:00100000:3.0:1787560701.606111:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787560701.606119:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+19:14307:x1874392815608704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560701.607193:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+19:14307:x1874392815608704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 377us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560701.607207:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787560701.607280:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560701.607343:0:14307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560701.607481:0:14307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560701.607650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560701.607699:0:14307:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560701.612694:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815608832 00000100:00100000:0.0:1787560701.612717:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815608832 00000100:00100000:0.0:1787560701.612775:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788352896 00000100:00100000:0.0:1787560701.612779:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788352896 00000100:00100000:0.0:1787560701.612804:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787560701.612817:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9865a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+19:14307:x1874392815608832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.613173:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9865a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:449b2653-031b-4a00-838c-f2377a91f8ff+19:14307:x1874392815608832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 358us (5691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560701.613182:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787560701.613235:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 117 00000100:00100000:0.0:1787560701.613244:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13739:x1874392788352896:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.614061:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13739:x1874392788352896:12345-192.168.201.56@tcp:501:ll_cfg_requeue.0 Request processed in 812us (6407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560701.614071:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 117 00000100:00100000:0.0:1787560701.614143:0:14307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:449b2653-031b-4a00-838c-f2377a91f8ff:14307:1874392815608832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787560701.617108:0:16520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787560701.617231:0:14307:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787560701.617262:0:14307:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560701.617277:0:14307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.156@tcp lock: ffff93d9812eb800/0xe34191b05674039d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567403a4 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560701.617291:0:14307:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.156@tcp lock: ffff93d9812eb800/0xe34191b05674039d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe34191b0567403a4 expref: -99 pid: 14307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560701.617928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560701.618228:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788353024 00000100:00100000:0.0:1787560701.618242:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788353024 00000100:00100000:0.0:1787560701.618312:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 118 00000100:00100000:0.0:1787560701.618325:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13739:x1874392788353024:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560701.625113:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:13739:x1874392788353024:12345-192.168.201.56@tcp:503:ll_cfg_requeue.0 Request processed in 6772us (7176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560701.625133:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 118 00010000:00010000:0.0:1787560702.609046:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560702.671192:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449b2653-031b-4a00-838c-f2377a91f8ff:3313:1874392815608960:0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.671258:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560702.671312:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815609472:0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.671340:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560702.671371:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787560702.671375:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815609088:0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.671393:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560702.671405:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815609600:0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.671426:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560702.671452:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815609344:0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.671488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560702.671509:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560702.671515:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d99840ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815609216:0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.671536:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560702.671559:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815609472 00000100:00100000:0.0:1787560702.671565:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815609472 00000100:00100000:0.0:1787560702.671600:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815609600 00000100:00100000:0.0:1787560702.671601:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815609600 00000100:00100000:0.0:1787560702.671610:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815609344 00000100:00100000:0.0:1787560702.671613:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815609344 00000100:00100000:0.0:1787560702.671627:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787560702.671635:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815609472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.671706:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874392815609472:12345-0@lo:400:kworker.0 Request processed in 72us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560702.671713:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787560702.671745:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560702.671753:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815609600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.671782:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874392815609600:12345-0@lo:400:kworker.0 Request processed in 30us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560702.671788:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560702.671800:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787560702.672004:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815609344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.672036:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874392815609344:12345-0@lo:400:kworker.0 Request processed in 34us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560702.672042:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787560702.672079:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874392815609344:0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.672105:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874392815609600:0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.672114:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874392815609472:0@lo:400:kworker.0 00000100:00100000:3.0:1787560702.672307:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815609088 00000100:00100000:3.0:1787560702.672312:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815609088 00000100:00100000:3.0:1787560702.672343:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815609216 00000100:00100000:3.0:1787560702.672347:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815609216 00000100:00100000:3.0:1787560702.672366:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560702.672372:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815609088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560702.672412:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815609088:12345-0@lo:400:kworker.0 Request processed in 40us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560702.672418:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560702.672430:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787560702.672444:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815609216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560702.672495:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874392815609216:12345-0@lo:400:kworker.0 Request processed in 35us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560702.672501:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787560702.672526:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560702.672530:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560702.672533:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560702.672555:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815609216:0@lo:400:kworker.0 00000100:00100000:3.0:1787560702.672577:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815609088:0@lo:400:kworker.0 00000100:00100000:1.0:1787560702.672976:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815608960 00000100:00100000:1.0:1787560702.672982:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815608960 00000100:00100000:1.0:1787560702.673023:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787560702.673031:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+19:3313:x1874392815608960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560702.673070:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:449b2653-031b-4a00-838c-f2377a91f8ff+19:3313:x1874392815608960:12345-0@lo:400:kworker.0 Request processed in 41us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560702.673076:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787560702.673306:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d99840d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:449b2653-031b-4a00-838c-f2377a91f8ff:3313:1874392815608960:0@lo:400:kworker.0 00000100:00100000:0.0:1787560702.673984:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815609728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560702.674013:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560702.674087:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815609728 00000100:00100000:2.0:1787560702.674100:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815609728 00000100:00100000:2.0:1787560702.674135:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560702.674141:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815609728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560702.674163:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787560702.674194:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815609728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560702.674198:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560702.674221:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815609728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560703.243187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.243547:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788353152 00000100:00100000:0.0:1787560703.243560:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788353152 00000100:00100000:0.0:1787560703.243646:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:0.0:1787560703.243657:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+6:14394:x1874392788353152:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560703.243679:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560703.243703:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92778 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.243767:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.243783:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.243795:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.243824:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.243893:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.243903:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.245049:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b0567403c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.245064:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b0567403c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.245073:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b0567403c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560703.245164:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000100:00080000:3.0:1787560703.245531:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787560703.250496:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560703.250759:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b0567403c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250777:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250785:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250792:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250799:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560703.250804:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250819:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250837:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560703.250841:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560703.250864:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250871:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250890:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250896:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250901:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250906:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eae00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560703.250909:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250915:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250921:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93d9a1269e00) 00010000:00010000:0.0:1787560703.250924:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560703.250927:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250942:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.250994:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92778 expref: 8 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.251009:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eb000/0xe34191b0567403c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92778 expref: 7 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.251016:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d9a1269400) 00010000:00010000:0.0:1787560703.251018:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560703.251021:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eb000, rc 0) 00000100:00100000:0.0:1787560703.251104:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+7:14394:x1874392788353152:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 7448us (7938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560703.251113:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:1.0:1787560703.264543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.264641:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788353408 00000100:00100000:3.0:1787560703.264657:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788353408 00000100:00100000:3.0:1787560703.264721:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:3.0:1787560703.264731:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+7:14394:x1874392788353408:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560703.264754:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560703.264776:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b0567403c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9277f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.264877:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567403ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.264901:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567403ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.264916:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567403ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265004:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b0567403d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265013:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b0567403d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265020:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b0567403d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265557:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbc00/0xe34191b0567403dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265568:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbc00/0xe34191b0567403dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265576:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbc00/0xe34191b0567403dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560703.265586:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787560703.265833:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567403ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265841:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567403ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265877:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567403ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265884:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dac00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560703.265889:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567403ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265907:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567403ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265921:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93d9a1269400) 00010000:00010000:3.0:1787560703.265924:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560703.265928:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567403ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265934:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567403ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265948:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b0567403d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265953:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b0567403d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265959:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b0567403d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265964:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560703.265967:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b0567403d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265973:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b0567403d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265979:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93d984e44900) 00010000:00010000:3.0:1787560703.265982:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560703.265984:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b0567403d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.265998:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b0567403d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.266395:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b0567403c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9277f expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.266411:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dbc00/0xe34191b0567403dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9277f expref: 9 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.266418:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d984e44400) 00010000:00010000:3.0:1787560703.266420:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560703.266423:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21dbc00, rc 0) 00000100:00100000:3.0:1787560703.266500:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+9:14394:x1874392788353408:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 1768us (1964us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787560703.266508:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:3.0:1787560703.280149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560703.280268:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788353536 00000100:00100000:2.0:1787560703.280285:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788353536 00000100:00100000:2.0:1787560703.280370:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:2.0:1787560703.280381:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+9:14394:x1874392788353536:12345-192.168.201.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787560703.280680:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+9:14394:x1874392788353536:12345-192.168.201.56@tcp:59:lhsmtool_posix.0 Request processed in 299us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560703.280688:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:2.0:1787560703.318507:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.318613:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788353664 00000100:00100000:0.0:1787560703.318629:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788353664 00000100:00100000:0.0:1787560703.318700:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:0.0:1787560703.318710:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+9:14400:x1874392788353664:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560703.318729:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560703.318748:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92786 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.318807:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.318821:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.318889:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.318905:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.318912:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.318920:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319137:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319145:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319152:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319158:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eae00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560703.319162:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319170:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319182:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560703.319185:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560703.319189:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319200:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b0567403f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319216:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319221:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319227:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319232:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560703.319235:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319252:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319259:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d9a1269e00) 00010000:00010000:0.0:1787560703.319261:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560703.319264:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319271:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567403f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319303:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92786 expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319322:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560703.319324:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560703.319328:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92786 expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.319338:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ebc00, rc 0) 00000100:00100000:0.0:1787560703.319404:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+9:14400:x1874392788353664:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 695us (915us total) trans 0 rc 301/301 00000100:00100000:0.0:1787560703.319411:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:1.0:1787560703.324543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.325617:0:14319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788353792 00000100:00100000:3.0:1787560703.325633:0:14319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788353792 00000100:00100000:3.0:1787560703.325917:0:14319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:3.0:1787560703.325931:0:14319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:936664d3-5703-46ce-869f-e8a83298bb2c+9:14400:x1874392788353792:12345-192.168.201.56@tcp:700:lfs.0 00000100:00100000:3.0:1787560703.326198:0:14319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:936664d3-5703-46ce-869f-e8a83298bb2c+9:14400:x1874392788353792:12345-192.168.201.56@tcp:700:lfs.0 Request processed in 269us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560703.326208:0:14319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:3.0:1787560703.328923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.328996:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788354048 00000100:00100000:0.0:1787560703.329013:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788354048 00000100:00100000:0.0:1787560703.329093:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:0.0:1787560703.329105:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+9:14400:x1874392788354048:12345-192.168.201.56@tcp:36:lfs.0 00010000:00010000:0.0:1787560703.329162:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560703.329187:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674032d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92701 expref: 9 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.329206:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560703.329211:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560703.329508:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.329524:0:14310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92763 expref: 5 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.329535:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.329577:0:14310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92763 expref: 5 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.329593:0:14310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92763 expref: 5 pid: 14344 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560703.329609:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3923800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14310:1874392815609856:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560703.329711:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987d46d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560703.332278:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3923800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14310:1874392815609856:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560703.332316:0:14310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560703.335407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.336127:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788354176 00000100:00100000:0.0:1787560703.336143:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788354176 00010000:00010000:0.0:1787560703.336220:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92763 expref: 6 pid: 14344 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560703.336268:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:0.0:1787560703.336280:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+6:2343:x1874392788354176:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560703.336299:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560703.336307:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92763 expref: 6 pid: 14344 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.336321:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92763 expref: 6 pid: 14344 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.336372:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261c00/0xe34191b056740365 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92763 expref: 6 pid: 14344 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.336391:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560703.336397:0:14296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.336409:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.336418:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.336449:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560703.336542:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2343:x1874392788354176:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 264us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560703.336550:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00010000:00010000:1.0:1787560703.336888:0:14310:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.336898:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.336930:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.336942:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.336952:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560703.338620:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787560703.338640:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.338650:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.338658:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.338665:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebc00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560703.338671:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.338679:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.338711:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d995c27300) 00010000:00010000:1.0:1787560703.338714:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560703.338720:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.338727:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567403ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560703.338755:0:14310:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e228af65 reply state 0000000080bc1395 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560703.338765:0:14310:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787560703.338944:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+10:14400:x1874392788354048:12345-192.168.201.56@tcp:36:lfs.0 Request processed in 9835us (10228us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787560703.338954:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00080000:3.0:1787560703.341019:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787560703.364448:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.364506:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.364514:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.364521:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560703.364527:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.364536:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.364579:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d995c27c00) 00010000:00010000:1.0:1787560703.364583:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560703.364588:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.364594:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b056740406 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560703.412114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560703.412169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560703.412202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560703.412240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560703.412263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.412426:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788354560 00000100:00100000:3.0:1787560703.412441:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788354560 00000100:00100000:3.0:1787560703.412533:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788354816 00000100:00100000:3.0:1787560703.412537:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788354816 00000100:00100000:3.0:1787560703.412552:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788354432 00000100:00100000:3.0:1787560703.412555:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788354432 00000100:00100000:3.0:1787560703.412567:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788354688 00000100:00100000:3.0:1787560703.412570:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788354688 00000100:00100000:3.0:1787560703.412587:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1787560703.412599:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936664d3-5703-46ce-869f-e8a83298bb2c+5:2345:x1874392788354560:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560703.412700:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936664d3-5703-46ce-869f-e8a83298bb2c+5:2345:x1874392788354560:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 103us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560703.412708:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1787560703.412741:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:3.0:1787560703.412748:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2345:x1874392788354816:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560703.412784:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2345:x1874392788354816:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 37us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560703.412790:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:3.0:1787560703.412802:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:3.0:1787560703.412808:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936664d3-5703-46ce-869f-e8a83298bb2c+5:2345:x1874392788354432:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560703.412832:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936664d3-5703-46ce-869f-e8a83298bb2c+5:2345:x1874392788354432:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560703.412837:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:3.0:1787560703.412890:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:3.0:1787560703.412897:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2345:x1874392788354688:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:3.0:1787560703.412921:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2345:x1874392788354688:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 25us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560703.412959:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00080000:1.0:1787560703.413563:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560703.413571:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560703.414340:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788354304 00000100:00100000:0.0:1787560703.414355:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788354304 00000100:00100000:0.0:1787560703.414423:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:0.0:1787560703.414433:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:2345:x1874392788354304:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560703.414582:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:2345:x1874392788354304:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 150us (2485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560703.414590:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 120 00000100:00100000:1.0:1787560703.460375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.460661:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788354944 00000100:00100000:3.0:1787560703.460675:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788354944 00000100:00100000:3.0:1787560703.460775:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:3.0:1787560703.460787:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+9:14409:x1874392788354944:12345-192.168.201.56@tcp:101:lctl.0 00010000:00010000:3.0:1787560703.460821:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560703.460888:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05674040d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9278d expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.460973:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b056740414 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.460989:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b056740414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.461115:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b056740414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560703.461199:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787560703.461204:0:14312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560703.461351:0:14312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b056740414 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.461383:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b05674040d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9278d expref: 11 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.461409:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db800/0xe34191b056740414 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9278d expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.461440:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d984e44900) 00010000:00010000:3.0:1787560703.461443:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560703.461447:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db800, rc 0) 00000100:00100000:3.0:1787560703.461793:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+10:14409:x1874392788354944:12345-192.168.201.56@tcp:101:lctl.0 Request processed in 1007us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560703.461801:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:3.0:1787560703.496155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560703.496743:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788355072 00000100:00100000:2.0:1787560703.496768:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788355072 00000100:00100000:2.0:1787560703.496897:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:2.0:1787560703.496910:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+5:14410:x1874392788355072:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560703.496939:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560703.496984:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674041b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92794 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.497078:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b056740422 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.497118:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b056740422 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.497131:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b056740422 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560703.497212:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787560703.497216:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560703.497250:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b056740422 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.497290:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674041b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92794 expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.497319:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711800/0xe34191b056740422 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92794 expref: 6 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.497330:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d984e44900) 00010000:00010000:2.0:1787560703.497333:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560703.497338:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711800, rc 0) 00000100:00100000:2.0:1787560703.497422:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+6:14410:x1874392788355072:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 514us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560703.497429:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:2.0:1787560703.503581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.503963:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788355200 00000100:00100000:3.0:1787560703.503990:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788355200 00000100:00100000:3.0:1787560703.504080:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:3.0:1787560703.504093:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61328c9-c3e1-4e42-a91a-11289a78c799+6:14410:x1874392788355200:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560703.504119:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560703.504145:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740429 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9279b expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.504232:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b056740430 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.504269:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b056740430 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.504283:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b056740430 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.504301:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b056740437 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.504309:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b056740437 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.504333:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b056740437 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.510391:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da400/0xe34191b05674043e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.510417:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da400/0xe34191b05674043e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.510430:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da400/0xe34191b05674043e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560703.510508:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787560703.510512:0:14312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560703.511665:0:14312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da400/0xe34191b05674043e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511687:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b056740430 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511694:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b056740430 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511700:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b056740430 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511706:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dac00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560703.511710:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b056740430 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511716:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b056740430 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511747:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d984e44900) 00010000:00010000:3.0:1787560703.511750:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560703.511755:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b056740430 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511761:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b056740430 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511779:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b056740437 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511785:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b056740437 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511790:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b056740437 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511795:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560703.511798:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b056740437 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511804:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b056740437 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511812:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d984e44000) 00010000:00010000:3.0:1787560703.511814:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560703.511817:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b056740437 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511823:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b056740437 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511894:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740429 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9279b expref: 8 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511910:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da400/0xe34191b05674043e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9279b expref: 7 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.511918:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d984e44a00) 00010000:00010000:3.0:1787560703.511920:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560703.511922:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21da400, rc 0) 00000100:00100000:3.0:1787560703.513663:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61328c9-c3e1-4e42-a91a-11289a78c799+7:14410:x1874392788355200:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 9562us (10087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560703.513676:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 22 00000100:00100000:1.0:1787560703.524271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560703.524405:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788355456 00000100:00100000:2.0:1787560703.524419:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788355456 00000100:00100000:2.0:1787560703.524520:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:2.0:1787560703.524534:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+7:14410:x1874392788355456:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560703.524579:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560703.524608:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b056740445 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927a2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560703.524787:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787560703.525640:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b056740445 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927a2 expref: 9 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.525664:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d984e44900) 00010000:00010000:2.0:1787560703.525667:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560703.525673:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b056740445 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927a2 expref: 9 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.525695:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710000, rc 0) 00000100:00100000:2.0:1787560703.526008:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+8:14410:x1874392788355456:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1471us (1746us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787560703.526018:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 23 00000100:00100000:2.0:1787560703.530321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.530645:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788355712 00000100:00100000:0.0:1787560703.530658:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788355712 00000100:00100000:0.0:1787560703.530740:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:0.0:1787560703.530772:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61328c9-c3e1-4e42-a91a-11289a78c799+8:14410:x1874392788355712:12345-192.168.201.56@tcp:36:lfs.0 00010000:00010000:0.0:1787560703.530890:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560703.530922:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21da400/0xe34191b05674043e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9279b expref: 8 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.530950:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d984e44a00) 00010000:00010000:0.0:1787560703.530975:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560703.531165:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.531182:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.531193:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560703.532724:0:14344:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdbcc79d reply state 000000008c558291 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560703.532745:0:14344:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787560703.532783:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787560703.533387:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61328c9-c3e1-4e42-a91a-11289a78c799+9:14410:x1874392788355712:12345-192.168.201.56@tcp:36:lfs.0 Request processed in 2604us (3063us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787560703.533399:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 24 00000100:00100000:2.0:1787560703.539802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.540399:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788355968 00000100:00100000:3.0:1787560703.540412:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788355968 00000100:00100000:3.0:1787560703.540505:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:3.0:1787560703.540518:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+9:14410:x1874392788355968:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:3.0:1787560703.540903:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+10:14410:x1874392788355968:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 387us (1115us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787560703.540909:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 2 00010000:00010000:1.0:1787560703.543912:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.543935:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.543962:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.543970:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eba00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560703.543975:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.543984:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.544004:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d9a1269e00) 00010000:00010000:1.0:1787560703.544008:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787560703.544015:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.544021:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740453 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560703.544506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560703.544589:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788356224 00000100:00100000:1.0:1787560703.544602:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788356224 00000100:00100000:1.0:1787560703.544701:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:1.0:1787560703.544724:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+9:14410:x1874392788356224:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:1.0:1787560703.544754:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560703.544777:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05674045a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927a9 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.544905:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b056740461 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.544921:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b056740461 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.544944:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b056740461 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.544962:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b056740468 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.544971:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b056740468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.544978:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b056740468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560703.545163:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787560703.545296:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b056740461 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545303:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b056740461 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545308:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b056740461 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545312:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560703.545315:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b056740461 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545320:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b056740461 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545327:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d984e44900) 00010000:00010000:1.0:1787560703.545329:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560703.545337:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b056740461 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545342:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b056740461 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545352:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b056740468 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545356:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b056740468 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545359:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b056740468 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545363:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560703.545364:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b056740468 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545367:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b056740468 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545371:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d995c27c00) 00010000:00010000:1.0:1787560703.545372:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560703.545374:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b056740468 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545377:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b056740468 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545409:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05674045a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927a9 expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545424:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d984e44900) 00010000:00010000:1.0:1787560703.545426:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560703.545429:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260a00/0xe34191b05674045a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927a9 expref: 11 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.545435:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4260a00, rc 0) 00000100:00100000:1.0:1787560703.545529:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+10:14410:x1874392788356224:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 818us (1029us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787560703.545538:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 25 00000100:00100000:2.0:1787560703.548091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.548217:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788356352 00000100:00100000:3.0:1787560703.548228:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788356352 00000100:00100000:3.0:1787560703.548290:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:3.0:1787560703.548298:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61328c9-c3e1-4e42-a91a-11289a78c799+10:14410:x1874392788356352:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560703.548327:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560703.548349:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740476 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927b0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.548473:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.548489:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.548502:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560703.548564:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787560703.548569:0:14312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560703.548591:0:14312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.548617:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740476 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b0 expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.548635:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b0 expref: 11 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.548642:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d984e44000) 00010000:00010000:3.0:1787560703.548644:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560703.548648:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db000, rc 0) 00000100:00100000:3.0:1787560703.548778:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a61328c9-c3e1-4e42-a91a-11289a78c799+11:14410:x1874392788356352:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 410us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560703.548786:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:0.0:1787560703.552725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.552817:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788356480 00000100:00100000:3.0:1787560703.552830:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788356480 00000100:00100000:3.0:1787560703.553176:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:3.0:1787560703.553187:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+11:14410:x1874392788356480:12345-192.168.201.56@tcp:37:lfs.0 00000100:00100000:3.0:1787560703.556892:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+11:14410:x1874392788356480:12345-192.168.201.56@tcp:37:lfs.0 Request processed in 3653us (4136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560703.556908:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 3 00000100:00100000:2.0:1787560703.559820:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.559894:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788356736 00000100:00100000:0.0:1787560703.559907:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788356736 00000100:00100000:2.0:1787560703.560061:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:2.0:1787560703.560075:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b5619c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+11:14410:x1874392788356736:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:2.0:1787560703.560459:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b5619c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+12:14410:x1874392788356736:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 382us (643us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787560703.560498:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 4 00000100:00100000:1.0:1787560703.598223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560703.598314:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788356864 00000100:00100000:2.0:1787560703.598324:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788356864 00000100:00100000:2.0:1787560703.598409:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:2.0:1787560703.598419:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+10:14416:x1874392788356864:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1787560703.598444:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560703.598485:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b056740484 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927b7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598576:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05674048b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598593:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05674048b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598609:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05674048b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598625:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b056740492 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598632:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b056740492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598639:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b056740492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598800:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b056740499 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598831:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b056740499 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598838:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b056740499 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560703.598904:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787560703.598908:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560703.598973:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b056740499 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598988:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05674048b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.598995:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05674048b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599002:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05674048b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599008:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560703.599014:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05674048b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599022:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05674048b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599036:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d984e44900) 00010000:00010000:2.0:1787560703.599040:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560703.599046:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05674048b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599063:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b05674048b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599079:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b056740492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599083:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b056740492 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599087:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b056740492 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599090:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560703.599091:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b056740492 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599095:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b056740492 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599099:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff93d987fff600) 00010000:00010000:2.0:1787560703.599101:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560703.599103:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b056740492 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599107:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b056740492 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599140:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b056740484 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b7 expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599159:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711600/0xe34191b056740499 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b7 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.599165:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d984e44000) 00010000:00010000:2.0:1787560703.599167:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787560703.599168:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711600, rc 0) 00000100:00100000:2.0:1787560703.599237:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+11:14416:x1874392788356864:12345-192.168.201.56@tcp:101:bash.0 Request processed in 819us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560703.599245:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:1.0:1787560703.603884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.604097:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788357120 00000100:00100000:3.0:1787560703.604110:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788357120 00000100:00100000:3.0:1787560703.604178:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 28 00000100:00100000:3.0:1787560703.604191:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+11:14416:x1874392788357120:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1787560703.604218:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560703.604241:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b0567404a0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927be expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.604612:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.604630:0:14312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b0 expref: 11 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.604638:0:14312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.604682:0:14312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b0 expref: 11 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.604699:0:14312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b0 expref: 11 pid: 14312 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560703.604747:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14312:1874392815609984:192.168.201.56@tcp:104: 00000100:00100000:3.0:1787560703.605281:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560703.607287:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14312:1874392815609984:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560703.607321:0:14312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560703.609242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.609409:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788357248 00000100:00100000:0.0:1787560703.609420:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788357248 00010000:00010000:0.0:1787560703.609482:0:14295:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b0 expref: 12 pid: 14312 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560703.609527:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:0.0:1787560703.609538:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+12:2342:x1874392788357248:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787560703.609573:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560703.609580:0:14295:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b0 expref: 12 pid: 14312 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.609592:0:14295:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b0 expref: 12 pid: 14312 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.609617:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674047d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927b0 expref: 12 pid: 14312 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.609639:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d984e44000) 00010000:00010000:0.0:1787560703.609645:0:14295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.609657:0:14295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.609666:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.609703:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787560703.609886:0:14312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.609893:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.609924:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.609932:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.609938:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.610674:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.610693:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.610702:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560703.610716:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787560703.610752:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.610772:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.610781:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.610788:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21dac00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560703.610793:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.610801:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.610813:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d984e44000) 00010000:00010000:1.0:1787560703.610816:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560703.610822:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.610828:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b0567404a7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560703.610914:0:14312:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060c4651a reply state 00000000e40c7a1c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560703.610931:0:14312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787560703.610980:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b0567404a0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927be expref: 14 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.610997:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927be expref: 13 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.611005:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:1.0:1787560703.611007:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787560703.611010:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9b4261000, rc 0) 00000100:00100000:0.0:1787560703.611284:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a61328c9-c3e1-4e42-a91a-11289a78c799+11:2342:x1874392788357248:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 1675us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560703.611296:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:1.0:1787560703.611512:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+14:14416:x1874392788357120:12345-192.168.201.56@tcp:101:bash.0 Request processed in 7323us (7663us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787560703.611520:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 28 00010000:00010000:1.0:1787560703.615478:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.615505:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.615514:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.615521:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560703.615527:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.615535:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.615580:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93d995c27c00) 00010000:00010000:1.0:1787560703.615582:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560703.615586:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.615591:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404ae lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560703.623320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.623484:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788357376 00000100:00100000:0.0:1787560703.623497:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788357376 00000100:00100000:0.0:1787560703.623575:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:0.0:1787560703.623588:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+13:14416:x1874392788357376:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560703.623646:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560703.623674:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b0567404c3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927c5 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.623769:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b0567404ca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.623786:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b0567404ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.623799:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b0567404ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560703.623890:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787560703.623896:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560703.624423:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b0567404ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.624437:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b0567404ca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.624476:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b0567404c3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927c5 expref: 15 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.624505:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b0567404ca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927c5 expref: 14 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.624515:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560703.624519:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560703.624523:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea400, rc 0) 00000100:00100000:0.0:1787560703.624620:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+14:14416:x1874392788357376:12345-192.168.201.56@tcp:101:bash.0 Request processed in 1033us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560703.624629:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 29 00000100:00100000:3.0:1787560703.628360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.628440:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788357632 00000100:00100000:0.0:1787560703.628451:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788357632 00000100:00100000:0.0:1787560703.628532:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 5 00000100:00100000:0.0:1787560703.628545:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+14:14416:x1874392788357632:12345-192.168.201.56@tcp:35:bash.0 00000100:00100000:0.0:1787560703.629230:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+15:14416:x1874392788357632:12345-192.168.201.56@tcp:35:bash.0 Request processed in 684us (878us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787560703.629240:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 5 00010000:00010000:0.0:1787560703.633287:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560703.696392:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560703.696426:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815610112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560703.696545:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560703.696882:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815610112 00000100:00100000:0.0:1787560703.696894:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815610112 00000100:00100000:0.0:1787560703.696953:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560703.696977:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815610112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560703.697027:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560703.697097:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815610112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560703.697106:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560703.697289:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815610112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560703.746260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.746582:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788357888 00000100:00100000:3.0:1787560703.746667:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788357888 00000100:00100000:3.0:1787560703.747315:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:2.0:1787560703.747799:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+15:14426:x1874392788357888:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560703.747837:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560703.747891:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567404d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927cc expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560703.748223:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787560703.748388:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567404d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927cc expref: 17 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.748407:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d984e44900) 00010000:00010000:2.0:1787560703.748428:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560703.748436:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567404d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927cc expref: 17 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560703.749350:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a711200, rc 0) 00000100:00100000:2.0:1787560703.749674:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+16:14426:x1874392788357888:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 2339us (3421us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787560703.749687:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 30 00000100:00100000:2.0:1787560703.756802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.757341:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788358144 00000100:00100000:0.0:1787560703.757357:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788358144 00000100:00100000:0.0:1787560703.757423:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:0.0:1787560703.757436:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936664d3-5703-46ce-869f-e8a83298bb2c+16:14426:x1874392788358144:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560703.758187:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936664d3-5703-46ce-869f-e8a83298bb2c+17:14426:x1874392788358144:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 750us (1398us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787560703.758195:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 6 00000100:00100000:2.0:1787560703.790154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560703.790365:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788358400 00000100:00100000:0.0:1787560703.790378:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788358400 00000100:00100000:0.0:1787560703.790449:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:0.0:1787560703.790469:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+17:14429:x1874392788358400:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:0.0:1787560703.790501:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560703.790529:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b0567404df lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927d3 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.790668:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567404e6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.790685:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567404e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.790699:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567404e6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560703.790712:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787560703.791118:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b0567404df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927d3 expref: 20 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.791144:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567404e6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927d3 expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560703.791151:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560703.791154:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560703.791157:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eba00, rc 0) 00000100:00100000:0.0:1787560703.791224:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+19:14429:x1874392788358400:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 766us (1087us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787560703.791248:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 31 00000100:00100000:2.0:1787560703.796707:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560703.796754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.796881:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788358656 00000100:00100000:3.0:1787560703.796893:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788358656 00000100:00100000:3.0:1787560703.796954:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:3.0:1787560703.796970:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936664d3-5703-46ce-869f-e8a83298bb2c+19:2344:x1874392788358656:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560703.796987:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560703.797024:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b0567404e6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927d3 expref: 19 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560703.797047:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:3.0:1787560703.797051:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560703.797105:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883426680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936664d3-5703-46ce-869f-e8a83298bb2c+18:2344:x1874392788358656:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 136us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560703.797111:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:1.0:1787560703.797351:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788358528 00000100:00100000:1.0:1787560703.797357:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788358528 00000100:00100000:1.0:1787560703.797392:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00100000:1.0:1787560703.797401:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d883424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+18:14429:x1874392788358528:12345-192.168.201.56@tcp:54:lfs.0 00010000:00010000:1.0:1787560703.797478:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.797494:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.797506:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.797538:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.797544:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.797548:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.797567:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560703.797571:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.797577:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.797582:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:1.0:1787560703.797585:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787560703.797587:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560703.797591:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260200/0xe34191b0567404f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560703.797623:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d883424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+18:14429:x1874392788358528:12345-192.168.201.56@tcp:54:lfs.0 Request processed in 225us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560703.797628:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 32 00000100:00100000:2.0:1787560703.801802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560703.802518:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788358912 00000100:00100000:3.0:1787560703.802533:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788358912 00000100:00100000:3.0:1787560703.802600:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 7 00000100:00100000:3.0:1787560703.802613:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+18:14429:x1874392788358912:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:3.0:1787560703.803822:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+19:14429:x1874392788358912:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 1198us (2027us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787560703.803890:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 7 00000040:00080000:0.0:1787560703.953982:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787560704.086769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560704.086977:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788359168 00000100:00100000:0.0:1787560704.086992:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788359168 00000100:00100000:0.0:1787560704.087347:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:0.0:1787560704.087360:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+19:14460:x1874392788359168:12345-192.168.201.56@tcp:101:cat.0 00010000:00010000:0.0:1787560704.087390:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560704.087416:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b0567404fb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927da expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.087568:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740502 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.087586:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740502 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.087600:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740502 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560704.087613:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787560704.088196:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b0567404fb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927da expref: 22 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.088228:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740502 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927da expref: 21 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.088238:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560704.088241:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560704.088261:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eae00, rc 0) 00000100:00100000:0.0:1787560704.088340:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+21:14460:x1874392788359168:12345-192.168.201.56@tcp:101:cat.0 Request processed in 983us (1595us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787560704.088349:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 33 00000100:00100000:1.0:1787560704.098076:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560704.100577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560704.101797:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788359552 00000100:00100000:3.0:1787560704.101815:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788359552 00000100:00100000:3.0:1787560704.101941:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:3.0:1787560704.101955:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:936664d3-5703-46ce-869f-e8a83298bb2c+21:2342:x1874392788359552:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560704.102250:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560704.102558:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740502 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927da expref: 21 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.103285:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:3.0:1787560704.103295:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560704.103392:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:936664d3-5703-46ce-869f-e8a83298bb2c+20:2342:x1874392788359552:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 1437us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560704.103403:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 1 00000100:00100000:0.0:1787560704.103517:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788359424 00000100:00100000:0.0:1787560704.103527:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788359424 00000100:00100000:0.0:1787560704.103574:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:0.0:1787560704.103582:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d99840d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936664d3-5703-46ce-869f-e8a83298bb2c+20:14460:x1874392788359424:12345-192.168.201.56@tcp:35:cat.0 00000100:00100000:0.0:1787560704.104170:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d99840d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936664d3-5703-46ce-869f-e8a83298bb2c+21:14460:x1874392788359424:12345-192.168.201.56@tcp:35:cat.0 Request processed in 431us (5951us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787560704.104180:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 8 00000100:00100000:1.0:1787560704.201982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560704.202167:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788359808 00000100:00100000:0.0:1787560704.202181:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788359808 00000100:00100000:0.0:1787560704.202254:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:0.0:1787560704.202267:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+21:14466:x1874392788359808:12345-192.168.201.56@tcp:101:dd.0 00010000:00010000:0.0:1787560704.202300:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560704.202328:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740510 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927e1 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.202472:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740517 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.202488:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.202500:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560704.202514:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787560704.202743:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740510 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927e1 expref: 24 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.202773:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740517 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927e1 expref: 23 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.202783:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560704.202786:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560704.202790:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ebc00, rc 0) 00000100:00100000:0.0:1787560704.203727:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+23:14466:x1874392788359808:12345-192.168.201.56@tcp:101:dd.0 Request processed in 1455us (1755us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787560704.203739:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 34 00000100:00100000:1.0:1787560704.209988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560704.210356:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788360064 00000100:00100000:0.0:1787560704.210370:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788360064 00000100:00100000:0.0:1787560704.210441:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 35 00000100:00100000:0.0:1787560704.210462:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+23:14466:x1874392788360064:12345-192.168.201.56@tcp:36:dd.0 00010000:00010000:0.0:1787560704.210539:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787560704.210573:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740517 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927e1 expref: 23 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.210616:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b0567404ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927c5 expref: 22 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.210633:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560704.210639:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560704.210977:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.211022:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.211034:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787560704.211095:0:14310:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787560704.211138:0:14310:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d491dd5 reply state 000000008281f016 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560704.211149:0:14310:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560704.211282:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+24:14466:x1874392788360064:12345-192.168.201.56@tcp:36:dd.0 Request processed in 830us (1311us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787560704.211291:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 35 00000020:00080000:0.0:1787560704.211298:0:14310:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787560704.216241:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560704.216262:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560704.216272:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560704.216278:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812eae00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560704.216284:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560704.216292:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560704.216336:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:2.0:1787560704.216340:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560704.216345:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560704.216351:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eae00/0xe34191b056740525 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560704.294201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560704.294320:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788360320 00000100:00100000:3.0:1787560704.294334:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788360320 00000100:00100000:3.0:1787560704.294409:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:3.0:1787560704.294422:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+23:14466:x1874392788360320:12345-192.168.201.56@tcp:35:dd.0 00000100:00100000:3.0:1787560704.295119:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+24:14466:x1874392788360320:12345-192.168.201.56@tcp:35:dd.0 Request processed in 693us (927us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1787560704.295129:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 9 00000100:00100000:1.0:1787560704.508778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560704.508924:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788360448 00000100:00100000:0.0:1787560704.508938:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788360448 00000100:00100000:0.0:1787560704.509013:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:0.0:1787560704.509024:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+24:14480:x1874392788360448:12345-192.168.201.56@tcp:101:stat.0 00010000:00010000:0.0:1787560704.509054:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560704.509080:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05674052c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927e8 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509158:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740533 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509175:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740533 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509189:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740533 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509223:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05674053a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509231:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05674053a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509237:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05674053a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509497:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740541 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509506:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509512:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560704.509557:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787560704.509561:0:14312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560704.509610:0:14312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509625:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740541 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509634:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740533 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509641:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740533 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509658:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740533 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509664:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ebc00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560704.509669:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740533 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509677:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740533 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509691:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d984e44000) 00010000:00010000:0.0:1787560704.509695:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560704.509701:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740533 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509774:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b056740533 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509796:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05674053a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509803:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05674053a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509810:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05674053a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509814:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea800 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:0.0:1787560704.509818:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05674053a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509834:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05674053a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509843:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93d9a1269500) 00010000:00010000:0.0:1787560704.509927:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560704.509932:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05674053a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509938:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b05674053a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.509987:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b05674052c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927e8 expref: 26 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.510001:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740541 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927e8 expref: 25 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.510129:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560704.510131:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560704.510134:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eba00, rc 0) 00000100:00100000:0.0:1787560704.510352:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+25:14480:x1874392788360448:12345-192.168.201.56@tcp:101:stat.0 Request processed in 1327us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560704.510362:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 36 00000100:00100000:1.0:1787560704.585056:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560704.585096:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788360704 00000100:00100000:0.0:1787560704.585111:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788360704 00000100:00100000:0.0:1787560704.585188:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 37 00000100:00100000:0.0:1787560704.585201:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+25:14486:x1874392788360704:12345-192.168.201.56@tcp:36:truncate.0 00010000:00010000:0.0:1787560704.585312:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560704.585344:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740541 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927e8 expref: 25 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.585373:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560704.585380:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560704.585680:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.585696:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.585708:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787560704.585766:0:14310:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1787560704.585803:0:14310:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000822290f reply state 00000000217da2d8 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560704.585813:0:14310:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560704.586019:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+27:14486:x1874392788360704:12345-192.168.201.56@tcp:36:truncate.0 Request processed in 818us (976us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787560704.586028:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 37 00000020:00080000:0.0:1787560704.586034:0:14310:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787560704.596009:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.596043:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.596080:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.596087:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560704.596094:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.596104:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.596134:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:3.0:1787560704.596139:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560704.596145:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.596152:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea400/0xe34191b056740548 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560704.655157:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560704.812896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560704.813648:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788360832 00000100:00100000:3.0:1787560704.813663:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788360832 00000100:00100000:3.0:1787560704.813755:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:3.0:1787560704.813768:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+26:14500:x1874392788360832:12345-192.168.201.56@tcp:101:stat.0 00010000:00010000:3.0:1787560704.813802:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560704.813829:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21daa00/0xe34191b05674054f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927ef expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.813943:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db400/0xe34191b056740556 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.813961:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db400/0xe34191b056740556 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814004:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db400/0xe34191b056740556 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814026:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674055d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814034:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674055d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814196:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674055d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814628:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814638:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814646:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560704.814697:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1787560704.814702:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787560704.814731:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814904:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814916:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db400/0xe34191b056740556 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814937:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db400/0xe34191b056740556 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814945:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db400/0xe34191b056740556 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814953:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560704.814958:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db400/0xe34191b056740556 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.814966:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db400/0xe34191b056740556 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815110:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d984e44000) 00010000:00010000:3.0:1787560704.815115:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560704.815120:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db400/0xe34191b056740556 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815128:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db400/0xe34191b056740556 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815150:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674055d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815156:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674055d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815162:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674055d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815167:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560704.815176:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674055d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815182:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674055d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815189:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93d984e44200) 00010000:00010000:3.0:1787560704.815191:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560704.815195:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674055d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815200:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b05674055d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815546:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21daa00/0xe34191b05674054f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927ef expref: 28 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815566:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927ef expref: 27 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560704.815642:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:3.0:1787560704.815645:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787560704.815649:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db200, rc 0) 00000100:00100000:3.0:1787560704.815989:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+27:14500:x1874392788360832:12345-192.168.201.56@tcp:101:stat.0 Request processed in 2210us (3129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560704.816000:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 38 00000100:00100000:1.0:1787560704.958142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560704.958253:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788361088 00000100:00100000:2.0:1787560704.958268:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788361088 00000100:00100000:2.0:1787560704.958350:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:2.0:1787560704.958364:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+27:14510:x1874392788361088:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:2.0:1787560704.958394:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560704.958422:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05674056b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927f6 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560704.958602:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787560704.958926:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05674056b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927f6 expref: 29 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560704.958944:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d984e44900) 00010000:00010000:2.0:1787560704.958948:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560704.958954:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b05674056b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927f6 expref: 29 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560704.958977:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710e00, rc 0) 00000100:00100000:2.0:1787560704.959066:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+28:14510:x1874392788361088:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 704us (938us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1787560704.959096:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 39 00000100:00100000:1.0:1787560704.970996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560704.971071:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788361344 00000100:00100000:0.0:1787560704.971091:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788361344 00000100:00100000:0.0:1787560704.971176:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 10 00000100:00100000:0.0:1787560704.971189:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b5618850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936664d3-5703-46ce-869f-e8a83298bb2c+28:14510:x1874392788361344:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560704.972134:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b5618850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936664d3-5703-46ce-869f-e8a83298bb2c+29:14510:x1874392788361344:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 938us (1147us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787560704.972146:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 10 00000040:00080000:0.0:1787560704.976078:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787560705.077312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560705.077453:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788361600 00000100:00100000:0.0:1787560705.077469:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788361600 00000100:00100000:0.0:1787560705.077640:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 40 00000100:00100000:0.0:1787560705.077656:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+29:14516:x1874392788361600:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560705.077694:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560705.077723:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740579 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf927fd expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.077939:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.077958:0:14312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927be expref: 30 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.077966:0:14312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927ef expref: 30 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.077975:0:14312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.078025:0:14312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927ef expref: 30 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.078041:0:14312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927ef expref: 30 pid: 14344 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560705.078069:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14312:1874392815610240:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560705.078203:0:14312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927be expref: 30 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.078211:0:14312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927be expref: 30 pid: 14312 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560705.078220:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14312:1874392815610368:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560705.078267:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987feef00 going to sleep for 11 seconds 00000100:00080000:1.0:1787560705.081988:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560705.085345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560705.085396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560705.085495:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788361728 00000100:00100000:3.0:1787560705.085509:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788361728 00010000:00010000:3.0:1787560705.085567:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927ef expref: 31 pid: 14344 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560705.085650:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788361856 00000100:00100000:3.0:1787560705.085654:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788361856 00010000:00010000:3.0:1787560705.085670:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927be expref: 32 pid: 14312 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560705.085687:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:3.0:1787560705.085697:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3881450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936664d3-5703-46ce-869f-e8a83298bb2c+32:2342:x1874392788361728:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560705.085718:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560705.085727:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927ef expref: 32 pid: 14344 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.085754:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927ef expref: 32 pid: 14344 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.085785:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:3.0:1787560705.085791:0:14297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.085802:0:14297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.085810:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560705.085947:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3881450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936664d3-5703-46ce-869f-e8a83298bb2c+32:2342:x1874392788361728:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 249us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560705.085955:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:3.0:1787560705.086023:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:3.0:1787560705.086030:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936664d3-5703-46ce-869f-e8a83298bb2c+31:2342:x1874392788361856:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560705.086044:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560705.086050:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927be expref: 31 pid: 14312 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.086061:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927be expref: 31 pid: 14312 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.086073:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:3.0:1787560705.086077:0:14297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.086085:0:14297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.086094:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.086117:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560705.086137:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936664d3-5703-46ce-869f-e8a83298bb2c+31:2342:x1874392788361856:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 106us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560705.086144:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00010000:00010000:0.0:1787560705.087882:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db200/0xe34191b056740564 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927ef expref: 30 pid: 14344 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560705.087920:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14312:1874392815610240:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560705.087937:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261000/0xe34191b0567404b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927be expref: 29 pid: 14312 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560705.087951:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14312:1874392815610368:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560705.087979:0:14312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.087990:0:14312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.087996:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560705.088046:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1787560705.088287:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b056740579 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927fd expref: 30 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.088312:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927fd expref: 29 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.088323:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560705.088327:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787560705.088330:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ea800, rc 0) 00000100:00100000:0.0:1787560705.088412:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+29:14516:x1874392788361600:12345-192.168.201.56@tcp:101:bash.0 Request processed in 10760us (11116us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1787560705.088421:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 40 00000100:00100000:1.0:1787560705.093002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560705.093140:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788362112 00000100:00100000:2.0:1787560705.093156:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788362112 00000100:00100000:2.0:1787560705.093443:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 41 00000100:00100000:2.0:1787560705.093458:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+29:14516:x1874392788362112:12345-192.168.201.56@tcp:36:bash.0 00010000:00010000:2.0:1787560705.093900:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560705.093925:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560705.093942:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560705.094014:0:14311:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1787560705.094041:0:14311:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000123400cd reply state 0000000044e5965b transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560705.094052:0:14311:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560705.094189:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+32:14516:x1874392788362112:12345-192.168.201.56@tcp:36:bash.0 Request processed in 733us (1203us total) trans 8589934618 rc 0/0 00010000:00010000:3.0:1787560705.097460:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.097484:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.097493:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.097527:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560705.097533:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.097543:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.097567:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:3.0:1787560705.097580:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560705.097585:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.097592:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b05674058e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560705.098090:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 41 00000020:00080000:2.0:1787560705.098102:0:14311:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787560705.099259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560705.099338:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788362240 00000100:00100000:3.0:1787560705.099353:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788362240 00000100:00100000:3.0:1787560705.099422:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:3.0:1787560705.099434:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+31:14516:x1874392788362240:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1787560705.099475:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560705.099500:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21daa00/0xe34191b056740595 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92804 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.099592:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21daa00/0xe34191b056740595 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92804 expref: 32 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.099609:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21daa00/0xe34191b056740595 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92804 expref: 32 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.099656:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:3.0:1787560705.099660:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787560705.099665:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21daa00, rc 0) 00000100:00100000:3.0:1787560705.099751:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+32:14516:x1874392788362240:12345-192.168.201.56@tcp:101:bash.0 Request processed in 319us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560705.099758:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 42 00000100:00100000:1.0:1787560705.107687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560705.107958:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788362368 00000100:00100000:0.0:1787560705.107973:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788362368 00000100:00100000:0.0:1787560705.108059:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:0.0:1787560705.108073:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+32:14516:x1874392788362368:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:0.0:1787560705.108103:0:14310:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560705.108132:0:14310:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05674059c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9280b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.108266:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.108283:0:14310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927fd expref: 33 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.108317:0:14310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.108363:0:14310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927fd expref: 33 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.108380:0:14310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927fd expref: 33 pid: 14312 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560705.108397:0:14310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14310:1874392815610496:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560705.108514:0:14310:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d987feef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560705.117072:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560705.117830:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788362496 00000100:00100000:3.0:1787560705.117870:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788362496 00010000:00010000:3.0:1787560705.117934:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927fd expref: 34 pid: 14312 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560705.117988:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:3.0:1787560705.118000:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936664d3-5703-46ce-869f-e8a83298bb2c+34:2342:x1874392788362496:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560705.118019:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560705.118028:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927fd expref: 34 pid: 14312 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.118046:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927fd expref: 34 pid: 14312 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.118076:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:3.0:1787560705.118082:0:14297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.118095:0:14297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.118128:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.118154:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560705.118248:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936664d3-5703-46ce-869f-e8a83298bb2c+34:2342:x1874392788362496:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 240us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560705.118587:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00010000:00010000:0.0:1787560705.120143:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ea800/0xe34191b056740580 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf927fd expref: 33 pid: 14312 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560705.120181:0:14310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14310:1874392815610496:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560705.120215:0:14310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.120226:0:14310:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.120245:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560705.120315:0:14310:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787560705.120321:0:14310:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787560705.120348:0:14310:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.120411:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812eba00/0xe34191b05674059c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9280b expref: 33 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.120433:0:14310:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9280b expref: 32 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560705.120455:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:0.0:1787560705.120458:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787560705.120463:0:14310:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812ebc00, rc 0) 00000100:00100000:0.0:1787560705.120540:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+32:14516:x1874392788362368:12345-192.168.201.56@tcp:101:bash.0 Request processed in 12469us (12869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560705.120550:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 43 00000100:00100000:1.0:1787560705.124976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560705.125067:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788362752 00000100:00100000:2.0:1787560705.125080:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788362752 00000100:00100000:2.0:1787560705.125160:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:2.0:1787560705.125173:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:936664d3-5703-46ce-869f-e8a83298bb2c+32:14516:x1874392788362752:12345-192.168.201.56@tcp:103:bash.0 00010000:00010000:2.0:1787560705.125195:0:14295:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787560705.125258:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9812ebc00/0xe34191b0567405a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9280b expref: 32 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560705.125290:0:14295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21daa00/0xe34191b056740595 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92804 expref: 31 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560705.125306:0:14295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d995c27300) 00010000:00010000:2.0:1787560705.125320:0:14295:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560705.125391:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:936664d3-5703-46ce-869f-e8a83298bb2c+30:14516:x1874392788362752:12345-192.168.201.56@tcp:103:bash.0 Request processed in 221us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560705.125400:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 2 00000100:00100000:1.0:1787560705.128609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560705.129148:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788362880 00000100:00100000:3.0:1787560705.129161:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788362880 00000100:00100000:3.0:1787560705.129248:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:3.0:1787560705.129266:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+30:14516:x1874392788362880:12345-192.168.201.56@tcp:58:bash.0 00010000:00010000:3.0:1787560705.129401:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.129421:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560705.129443:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560705.133160:0:14344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560705.133553:0:14344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787560705.133994:0:14344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787560705.134271:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+30:14516:x1874392788362880:12345-192.168.201.56@tcp:58:bash.0 Request processed in 4998us (5668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560705.134286:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 44 00000100:00100000:1.0:1787560705.137820:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560705.138098:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788363008 00000100:00100000:2.0:1787560705.138111:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788363008 00000100:00100000:2.0:1787560705.138190:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 45 00000100:00100000:2.0:1787560705.138202:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+30:14516:x1874392788363008:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:2.0:1787560705.138229:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560705.138274:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b0567405b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92812 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560705.138349:0:14311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560705.138362:0:14311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b0567405b1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92812 expref: 31 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560705.138397:0:14311:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560705.138413:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b0567405b1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92812 expref: 31 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560705.138430:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d984e44200) 00010000:00010000:2.0:1787560705.138433:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560705.138448:0:14311:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b0567405b1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92812 expref: 31 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560705.138457:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710200, rc 0) 00000100:00100000:2.0:1787560705.138533:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+31:14516:x1874392788363008:12345-192.168.201.56@tcp:101:bash.0 Request processed in 333us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560705.138541:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 45 00010000:00010000:0.0:1787560705.679279:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787560705.876054:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000001:00080000:0.0:1787560705.876099:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1787560705.876109:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1787560705.876116:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:0.0:1787560705.876129:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:0.0:1787560706.001355:0:14345:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787560706.001368:0:14345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560706.001438:0:14345:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787560706.001446:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787560706.001626:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14345:1874392815610624:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787560706.001797:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9860eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560706.005603:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14345:1874392815610624:192.168.201.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787560706.015111:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.015324:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788363136 00000100:00100000:2.0:1787560706.015338:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788363136 00000100:00100000:2.0:1787560706.015411:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:2.0:1787560706.015442:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:936664d3-5703-46ce-869f-e8a83298bb2c+10:14517:x1874392788363136:12345-192.168.201.56@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787560706.015561:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:936664d3-5703-46ce-869f-e8a83298bb2c+10:14517:x1874392788363136:12345-192.168.201.56@tcp:900:lhsmtool_posix.0 Request processed in 139us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560706.015570:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:1.0:1787560706.027328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560706.027484:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788363264 00000100:00100000:0.0:1787560706.027519:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788363264 00000100:00100000:0.0:1787560706.027603:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:0.0:1787560706.027615:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+10:14517:x1874392788363264:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787560706.027659:0:14312:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787560706.028020:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+10:14517:x1874392788363264:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 404us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560706.028029:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 46 00000100:00100000:3.0:1787560706.032829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.033052:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788363392 00000100:00100000:2.0:1787560706.033066:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788363392 00000100:00100000:2.0:1787560706.033158:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:2.0:1787560706.033171:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+10:14517:x1874392788363392:12345-192.168.201.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.033299:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b0567405b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033321:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b0567405b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033336:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b0567405b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033535:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033564:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033581:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033622:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033632:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033639:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560706.033688:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787560706.033692:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560706.033713:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033722:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b0567405b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033742:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b0567405b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033747:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b0567405b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033750:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560706.033754:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b0567405b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033760:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b0567405b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033771:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d984e44400) 00010000:00010000:2.0:1787560706.033773:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560706.033776:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b0567405b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033779:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b0567405b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033796:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033800:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033803:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033806:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560706.033812:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033818:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033825:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff93d987fff800) 00010000:00010000:2.0:1787560706.033828:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560706.033831:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.033835:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.034135:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.034143:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.034149:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.034154:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560706.034158:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.034164:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.034173:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d984e44200) 00010000:00010000:2.0:1787560706.034176:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560706.034186:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.034192:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560706.034307:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+10:14517:x1874392788363392:12345-192.168.201.56@tcp:34:lhsmtool_posix.0 Request processed in 1134us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560706.034315:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 47 00000100:00100000:1.0:1787560706.040689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.040760:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788363648 00000100:00100000:2.0:1787560706.040771:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788363648 00000100:00100000:2.0:1787560706.040823:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:2.0:1787560706.040831:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9bf982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+10:14517:x1874392788363648:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.040873:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560706.040891:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92819 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.040982:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.040995:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.041004:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560706.041012:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787560706.041145:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.041153:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.041175:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.041180:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560706.041185:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.041192:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.041205:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d984e44200) 00010000:00010000:2.0:1787560706.041208:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560706.041213:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405d4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.041219:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.041263:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405cd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92819 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.041272:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93d984e44400) 00010000:00010000:2.0:1787560706.041273:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560706.041276:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92819 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.041286:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710c00, rc 0) 00000100:00100000:2.0:1787560706.041354:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9bf982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+11:14517:x1874392788363648:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 523us (673us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1787560706.041371:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 48 00000100:00100000:3.0:1787560706.043524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560706.043624:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788363776 00000100:00100000:0.0:1787560706.043635:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788363776 00000100:00100000:0.0:1787560706.043701:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:0.0:1787560706.043709:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+11:14517:x1874392788363776:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787560706.043748:0:14310:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787560706.043866:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+11:14517:x1874392788363776:12345-192.168.201.56@tcp:53:lhsmtool_posix.0 Request processed in 138us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560706.043871:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 49 00000100:00100000:3.0:1787560706.047800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.047888:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788364032 00000100:00100000:2.0:1787560706.047896:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788364032 00000100:00100000:2.0:1787560706.047947:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:2.0:1787560706.047955:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+11:14517:x1874392788364032:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.047972:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560706.047988:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405e2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92820 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560706.048920:0:14344:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1787560706.048929:0:14344:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1787560706.048980:0:14344:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787560706.049276:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.049291:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.049302:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.049364:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711400/0xe34191b0567405e2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92820 expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.049383:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92820 expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.049393:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff800) 00010000:00010000:2.0:1787560706.049406:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560706.049411:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d98a710e00, rc 0) 00000100:00100000:2.0:1787560706.049505:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+13:14517:x1874392788364032:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 1549us (1712us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787560706.049513:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 50 00000100:00100000:1.0:1787560706.059401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.059491:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788364288 00000100:00100000:2.0:1787560706.059503:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788364288 00000100:00100000:2.0:1787560706.059568:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:2.0:1787560706.059580:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+13:14517:x1874392788364288:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.059644:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560706.059670:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710e00/0xe34191b0567405e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92820 expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.059694:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff800) 00010000:00010000:2.0:1787560706.059706:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560706.059729:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405f7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.059742:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.059752:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.059814:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405fe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb02bdfa4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.059822:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb02bdfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.059884:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb02bdfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060153:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405f7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060162:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405f7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060168:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060174:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a710c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560706.060179:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405f7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060186:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405f7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060196:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d984e44000) 00010000:00010000:2.0:1787560706.060199:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560706.060203:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060209:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710c00/0xe34191b0567405f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060219:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb02bdfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060226:0:14310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405fe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb02bdfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060239:0:14310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb02bdfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060245:0:14310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d98a711200 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:2.0:1787560706.060247:0:14310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb02bdfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060253:0:14310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405fe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb02bdfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060261:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb02bdfa4 (ffff93d987fff600) 00010000:00010000:2.0:1787560706.060263:0:14310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560706.060266:0:14310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405fe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb02bdfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.060272:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a711200/0xe34191b0567405fe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb02bdfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560706.060353:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+12:14517:x1874392788364288:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 774us (965us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560706.060362:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 51 00000100:00100000:3.0:1787560706.065330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.065413:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788364416 00000100:00100000:2.0:1787560706.065433:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788364416 00000100:00100000:2.0:1787560706.065500:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:2.0:1787560706.065511:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+12:14517:x1874392788364416:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.065532:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560706.065555:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b056740605 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92827 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.065617:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044a00/0xe34191b05674060c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.065631:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044a00/0xe34191b05674060c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.065643:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044a00/0xe34191b05674060c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.065769:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710000/0xe34191b056740605 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92827 expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.065793:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044a00/0xe34191b05674060c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92827 expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.065802:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff500) 00010000:00010000:2.0:1787560706.065805:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560706.065809:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2044a00, rc 0) 00000100:00100000:2.0:1787560706.065895:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+13:14517:x1874392788364416:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 385us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560706.065902:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 52 00000100:00100000:1.0:1787560706.074334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.074432:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788364672 00000100:00100000:2.0:1787560706.074442:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788364672 00000100:00100000:2.0:1787560706.074516:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:2.0:1787560706.074528:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+13:14517:x1874392788364672:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.074621:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.074666:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.074686:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560706.075229:0:14310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787560706.075240:0:14310:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 534828392435ns, next at 535828389925ns, rc = 0 00000004:00010000:2.0:1787560706.075328:0:14310:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d05c6f58 reply state 000000002e056c36 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560706.075339:0:14310:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560706.075462:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+15:14517:x1874392788364672:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 935us (1137us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1787560706.075471:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 53 00000100:00100000:1.0:1787560706.082448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:3.0:1787560706.082592:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.082607:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.082636:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.082643:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560706.082648:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.082656:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.082688:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff500) 00010000:00010000:3.0:1787560706.082693:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787560706.082698:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.082705:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b056740613 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560706.083804:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788364800 00000100:00100000:2.0:1787560706.083817:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788364800 00000100:00100000:2.0:1787560706.084004:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:2.0:1787560706.084016:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+14:14517:x1874392788364800:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.084039:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560706.084062:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05674061a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9282e expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.084127:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05674061a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9282e expref: 15 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.084141:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05674061a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9282e expref: 15 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.084182:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff500) 00010000:00010000:2.0:1787560706.084186:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560706.084189:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2044600, rc 0) 00000100:00100000:2.0:1787560706.084258:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+15:14517:x1874392788364800:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 245us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560706.084265:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 54 00000100:00100000:3.0:1787560706.091723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560706.092012:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788364928 00000100:00100000:0.0:1787560706.092024:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788364928 00000100:00100000:0.0:1787560706.092109:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:0.0:1787560706.092123:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936664d3-5703-46ce-869f-e8a83298bb2c+5:2343:x1874392788364928:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787560706.092522:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560706.092761:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936664d3-5703-46ce-869f-e8a83298bb2c+6:2343:x1874392788364928:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 Request processed in 640us (1047us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787560706.092770:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:1.0:1787560706.099199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560706.099295:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788365184 00000100:00100000:3.0:1787560706.099306:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788365184 00000100:00100000:3.0:1787560706.099377:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:3.0:1787560706.099388:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+15:14517:x1874392788365184:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787560706.099664:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+16:14517:x1874392788365184:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 277us (475us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787560706.099673:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 11 00000100:00100000:1.0:1787560706.106565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.106685:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788365440 00000100:00100000:2.0:1787560706.106697:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788365440 00000100:00100000:2.0:1787560706.106765:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:2.0:1787560706.106777:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+16:14517:x1874392788365440:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787560706.106951:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+16:14517:x1874392788365440:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 175us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560706.106958:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 55 00000100:00100000:1.0:1787560706.111620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.111814:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788365568 00000100:00100000:2.0:1787560706.111827:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788365568 00000100:00100000:2.0:1787560706.112008:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:2.0:1787560706.112020:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+16:14517:x1874392788365568:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.112042:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560706.112064:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740621 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92835 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.112170:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b056740628 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.112185:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b056740628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.112203:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b056740628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560706.112237:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787560706.112256:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b056740628 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.112291:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740621 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92835 expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.112311:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b056740628 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92835 expref: 17 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.112319:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff500) 00010000:00010000:2.0:1787560706.112322:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787560706.112327:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2044e00, rc 0) 00000100:00100000:2.0:1787560706.112426:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+17:14517:x1874392788365568:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 400us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560706.112433:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 56 00000100:00100000:1.0:1787560706.123001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.123073:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788365696 00000100:00100000:2.0:1787560706.123083:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788365696 00000100:00100000:2.0:1787560706.123143:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:2.0:1787560706.123153:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+6:2343:x1874392788365696:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.123170:0:14996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560706.123190:0:14996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05674062f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9283c expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787560706.123234:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c0302, blocks: 0x1 00010000:00010000:2.0:1787560706.123255:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=534s v=(0 0) 00010000:00010000:2.0:1787560706.123261:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560706.123270:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05674062f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9283c expref: 7 pid: 14996 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.123289:0:14996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05674062f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9283c expref: 7 pid: 14996 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.123304:0:14996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c2045e00, rc 0) 00000100:00100000:2.0:1787560706.123383:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+7:2343:x1874392788365696:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 231us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560706.123390:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:1.0:1787560706.129950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.130038:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788365952 00000100:00100000:2.0:1787560706.130049:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788365952 00000100:00100000:2.0:1787560706.130110:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:2.0:1787560706.130121:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+17:14517:x1874392788365952:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787560706.130234:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+17:14517:x1874392788365952:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 114us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560706.130242:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 57 00000100:00100000:1.0:1787560706.136693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560706.137597:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788366080 00000100:00100000:0.0:1787560706.137611:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788366080 00000100:00100000:0.0:1787560706.137677:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 58 00000100:00100000:0.0:1787560706.137688:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+17:14517:x1874392788366080:12345-192.168.201.56@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787560706.245934:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:0.0:1787560706.245957:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787560706.245983:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:3.0:1787560706.246262:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815610752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787560706.246370:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560706.246470:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815610752 00000100:00100000:0.0:1787560706.246480:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815610752 00000100:00100000:0.0:1787560706.246558:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560706.246570:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815610752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787560706.246725:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+13:14517:x1874392788366080:12345-192.168.201.56@tcp:44:lhsmtool_posix.0 Request processed in 109027us (110032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560706.246736:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 58 00002000:00010000:0.0:1787560706.246764:0:14998:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787560706.246967:0:14998:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787560706.246971:0:14998:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787560706.246973:0:14998:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787560706 -> 1787560706 00002000:00010000:0.0:1787560706.246976:0:14998:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787560706.247027:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1874392815610752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 458us (656us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787560706.247034:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1787560706.247128:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93d9b3920380/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787560706.247136:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815610752:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1787560706.248946:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560706.251493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.251578:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788366208 00000100:00100000:2.0:1787560706.251610:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788366208 00000100:00100000:2.0:1787560706.251691:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:2.0:1787560706.251703:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+7:2342:x1874392788366208:12345-192.168.201.56@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787560706.252019:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+7:2342:x1874392788366208:12345-192.168.201.56@tcp:16:lhsmtool_posix.0 Request processed in 317us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560706.252029:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:0.0:1787560706.269676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.269798:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788366464 00000100:00100000:2.0:1787560706.269812:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788366464 00000100:00100000:2.0:1787560706.269924:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:2.0:1787560706.269938:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+13:14517:x1874392788366464:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.270025:0:14310:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560706.270081:0:14310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044e00/0xe34191b056740628 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92835 expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.270114:0:14310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff500) 00010000:00010000:2.0:1787560706.270120:0:14310:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560706.270177:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.270198:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.270212:0:14310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560706.270775:0:14310:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000342b8959 reply state 000000002228b282 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560706.270790:0:14310:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787560706.270988:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:936664d3-5703-46ce-869f-e8a83298bb2c+14:14517:x1874392788366464:12345-192.168.201.56@tcp:36:lhsmtool_posix.0 Request processed in 1051us (1324us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1787560706.270997:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 59 00000100:00100000:2.0:1787560706.273644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560706.273805:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788366592 00000100:00100000:0.0:1787560706.273818:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788366592 00000100:00100000:0.0:1787560706.273932:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:0.0:1787560706.273945:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936664d3-5703-46ce-869f-e8a83298bb2c+7:14517:x1874392788366592:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560706.273990:0:14997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560706.274016:0:14997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92843 expref: -99 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.274057:0:14997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05674062f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9283c expref: 8 pid: 14996 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.274068:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787560706.274074:0:14997:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560706.274079:0:14997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 8 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.274126:0:14997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05674062f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9283c expref: 8 pid: 14996 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.274139:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.274142:0:14997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05674062f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9283c expref: 8 pid: 14996 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.274150:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.274157:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560706.274159:0:14997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14997:1874392815610880:192.168.201.56@tcp:104: 00010000:00010000:3.0:1787560706.274164:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:3.0:1787560706.274169:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.274178:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.274197:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff500) 00010000:00010000:3.0:1787560706.274200:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560706.274205:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.274210:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044c00/0xe34191b056740636 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14310 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560706.274283:0:14997:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d990476b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560706.276659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560706.276937:0:14997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14997:1874392815610880:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560706.276994:0:14997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 8 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.277021:0:14997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9812eba00, rc 0) 00000100:00100000:0.0:1787560706.277218:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936664d3-5703-46ce-869f-e8a83298bb2c+8:14517:x1874392788366592:12345-192.168.201.56@tcp:101:lhsmtool_posix.0 Request processed in 3275us (3585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560706.277228:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:3.0:1787560706.277467:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788366720 00000100:00100000:3.0:1787560706.277475:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788366720 00010000:00010000:3.0:1787560706.277517:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05674062f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9283c expref: 8 pid: 14996 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560706.277555:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:3.0:1787560706.277565:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:936664d3-5703-46ce-869f-e8a83298bb2c+8:2343:x1874392788366720:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560706.277588:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560706.277618:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05674062f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9283c expref: 8 pid: 14996 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.277632:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05674062f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9283c expref: 8 pid: 14996 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.277660:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e9fb84b/0xe34191b05674062f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9283c expref: 8 pid: 14996 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.277843:0:14296:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560706.277907:0:14296:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560706.277917:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 7 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.277928:0:14296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 7 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.277973:0:14296:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 7 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560706.277992:0:14296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14296:1874392815611008:192.168.201.56@tcp:105: 00000100:00100000:3.0:1787560706.278068:0:14296:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d985120f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560706.284889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560706.285061:0:14296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14296:1874392815611008:192.168.201.56@tcp:105: 00010000:00010000:3.0:1787560706.285094:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560706.285168:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:936664d3-5703-46ce-869f-e8a83298bb2c+7:2343:x1874392788366720:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 7604us (8521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560706.285181:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:0.0:1787560706.286640:0:16185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788366848 00000100:00100000:0.0:1787560706.286658:0:16185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788366848 00000100:00100000:0.0:1787560706.286732:0:16185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:0.0:1787560706.286744:0:16185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936664d3-5703-46ce-869f-e8a83298bb2c+7:2344:x1874392788366848:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787560706.287049:0:16185:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787560706.287054:0:16185:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787560705 00002000:00010000:0.0:1787560706.287056:0:16185:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787560703 00002000:00010000:0.0:1787560706.287058:0:16185:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787560706 -> 1787560705 00002000:00010000:0.0:1787560706.287060:0:16185:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787560706.287139:0:16185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:936664d3-5703-46ce-869f-e8a83298bb2c+8:2344:x1874392788366848:12345-192.168.201.56@tcp:2:lhsmtool_posix.0 Request processed in 397us (2301us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787560706.287148:0:16185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 17 00000100:00100000:1.0:1787560706.298497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560706.301182:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788366976 00000100:00100000:0.0:1787560706.301203:0:14998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788366976 00000100:00100000:0.0:1787560706.301309:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:0.0:1787560706.301322:0:14998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936664d3-5703-46ce-869f-e8a83298bb2c+8:2343:x1874392788366976:12345-192.168.201.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787560706.301385:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.301411:0:14998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 8 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.301432:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560706.301467:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787560706.301473:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.301525:0:14998:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 8 pid: 14997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.301543:0:14998:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 8 pid: 14997 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560706.301561:0:14998:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3922680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14998:1874392815611136:192.168.201.56@tcp:104: 00000100:00100000:0.0:1787560706.301693:0:14998:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d990476b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560706.309291:0:14998:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3922680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14998:1874392815611136:192.168.201.56@tcp:104: 00010000:00010000:0.0:1787560706.309348:0:14998:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560706.311461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560706.311676:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788367104 00000100:00100000:3.0:1787560706.311688:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788367104 00010000:00010000:3.0:1787560706.311744:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 9 pid: 14997 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560706.311794:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:3.0:1787560706.311806:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4225880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936664d3-5703-46ce-869f-e8a83298bb2c+9:2343:x1874392788367104:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560706.311827:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560706.311898:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 9 pid: 14997 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.311915:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 9 pid: 14997 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.311944:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aa061b6/0xe34191b05674063d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92843 expref: 9 pid: 14997 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.311971:0:14297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560706.311977:0:14297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787560706.311984:0:14297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.311996:0:14297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.312055:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560706.312138:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:936664d3-5703-46ce-869f-e8a83298bb2c+8:2343:x1874392788367104:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 334us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560706.312147:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00010000:00010000:1.0:1787560706.312340:0:14998:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.312352:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.312382:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.312390:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.312399:0:14998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.312406:0:14998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9812ea800 already unused, calling callback (ffffffffc170c230) 00010000:00010000:1.0:1787560706.312411:0:14998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.312429:0:14998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.312447:0:14998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.312466:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0dd1308/0xe34191b056740644 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560706.312540:0:14998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:936664d3-5703-46ce-869f-e8a83298bb2c+7:2343:x1874392788366976:12345-192.168.201.56@tcp:1:lhsmtool_posix.0 Request processed in 11220us (14060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560706.312550:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:1.0:1787560706.316276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.316371:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788367360 00000100:00100000:2.0:1787560706.316386:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788367360 00000100:00100000:2.0:1787560706.316503:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 60 00000100:00100000:2.0:1787560706.316515:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+13:14517:x1874392788367360:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787560706.316639:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05674064b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.316663:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05674064b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.316678:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05674064b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.317072:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.317087:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05674061a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9282e expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.317096:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.317142:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05674061a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9282e expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.317159:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05674061a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9282e expref: 14 pid: 14344 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560706.317177:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf37100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14344:1874392815611264:192.168.201.56@tcp:104: 00000100:00100000:2.0:1787560706.317297:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bf9ddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560706.322045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560706.322381:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788367488 00000100:00100000:1.0:1787560706.322394:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788367488 00010000:00010000:1.0:1787560706.322476:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05674061a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9282e expref: 15 pid: 14344 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560706.322528:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 16 00000100:00100000:1.0:1787560706.322542:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:936664d3-5703-46ce-869f-e8a83298bb2c+15:2342:x1874392788367488:12345-192.168.201.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560706.322564:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560706.322573:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05674061a lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9282e expref: 15 pid: 14344 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.322590:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05674061a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9282e expref: 15 pid: 14344 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.322621:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff500) 00010000:00010000:1.0:1787560706.322629:0:14296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.322642:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.322678:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.322705:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560706.322791:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:936664d3-5703-46ce-869f-e8a83298bb2c+15:2342:x1874392788367488:12345-192.168.201.56@tcp:103:ldlm_bl.0 Request processed in 252us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560706.322800:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 16 00010000:00010000:2.0:1787560706.323045:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b05674061a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9282e expref: 14 pid: 14344 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560706.323082:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf37100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14344:1874392815611264:192.168.201.56@tcp:104: 00010000:00010000:2.0:1787560706.323111:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.323122:0:14344:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.323128:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560706.323399:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787560706.324895:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1787560706.324971:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1787560706.325101:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9baf37100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14344:1874392815611392:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787560706.325409:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560706.325567:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998b7a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787560706.326467:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815611392 00000100:00100000:2.0:1787560706.326479:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815611392 00000100:00100000:2.0:1787560706.326594:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560706.326605:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1874392815611392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787560706.326734:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1874392815611392:12345-0@lo:1000:mdt00_003.0 Request processed in 131us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560706.326742:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560706.326831:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9baf37100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14344:1874392815611392:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787560706.327547:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1787560706.327638:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14344:1874392815611520:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787560706.327683:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560706.328580:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d9bf9ddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560706.328730:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815611520 00000100:00100000:1.0:1787560706.328738:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815611520 00000100:00100000:1.0:1787560706.328979:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560706.328991:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14344:x1874392815611520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787560706.329244:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14344:x1874392815611520:12345-0@lo:1000:mdt00_003.0 Request processed in 256us (1560us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787560706.329253:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560706.329561:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d98641e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:14344:1874392815611520:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787560706.329996:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330008:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330016:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330022:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2045e00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560706.330027:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330035:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330072:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff500) 00010000:00010000:1.0:1787560706.330076:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560706.330081:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330088:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2045e00/0xe34191b056740652 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330126:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330131:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330136:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330141:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c21db000 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560706.330143:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330149:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330155:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d984e44200) 00010000:00010000:1.0:1787560706.330157:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560706.330165:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b0567405b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92812 expref: 17 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330175:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b0567405b1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92812 expref: 17 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330190:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b0567405b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92812 expref: 17 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.330225:0:14344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93d98a710200/0xe34191b0567405b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92812 expref: 17 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560706.330238:0:14344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b4227800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14344:1874392815611648:192.168.201.56@tcp:105: 00000100:00100000:1.0:1787560706.330504:0:14344:0:(client.c:2715:ptlrpc_set_wait()) set ffff93d998bbca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560706.342322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560706.342515:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788367616 00000100:00100000:0.0:1787560706.342527:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788367616 00000100:00100000:0.0:1787560706.342605:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:0.0:1787560706.342616:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+18:14516:x1874392788367616:12345-192.168.201.56@tcp:49:bash.0 00000100:00100000:1.0:1787560706.342892:0:14344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b4227800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14344:1874392815611648:192.168.201.56@tcp:105: 00010000:00010000:1.0:1787560706.342925:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.342936:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21db000/0xe34191b0567405aa lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.342978:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b056740659 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.342990:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b056740659 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343000:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b056740659 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343010:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b056740659 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343016:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b056740659 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343037:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b056740659 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343044:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560706.343048:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b056740659 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343055:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b056740659 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343069:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d984e44200) 00010000:00010000:1.0:1787560706.343073:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560706.343076:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b056740659 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343082:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b056740659 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343093:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05674064b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343099:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05674064b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343105:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05674064b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343109:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044400 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560706.343112:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05674064b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343125:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05674064b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343136:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d984e44200) 00010000:00010000:1.0:1787560706.343139:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787560706.343142:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05674064b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.343147:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044400/0xe34191b05674064b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560706.343268:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+18:14516:x1874392788367616:12345-192.168.201.56@tcp:49:bash.0 Request processed in 648us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560706.343280:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 12 00000100:00100000:1.0:1787560706.343404:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+17:14517:x1874392788367360:12345-192.168.201.56@tcp:57:lhsmtool_posix.0 Request processed in 26887us (27153us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1787560706.343430:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 60 00000020:00080000:1.0:1787560706.343437:0:14344:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787560706.346593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560706.346753:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788367872 00000100:00100000:2.0:1787560706.346768:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788367872 00000100:00100000:2.0:1787560706.346905:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 13 00000100:00100000:2.0:1787560706.346917:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d98641ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+17:14517:x1874392788367872:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1787560706.347088:0:14345:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787560706.347095:0:14345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560706.347155:0:14345:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787560706.347164:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000004:00080000:2.0:1787560706.348491:0:14313:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787560706.349952:0:14313:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1787560706.350037:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.350055:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560706.350058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00010000:00010000:2.0:1787560706.350076:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.350085:0:14313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.350093:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.350099:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560706.350117:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560706.350143:0:14298:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560706.350154:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.350167:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9c2044600 already unused, calling callback (ffffffffc170c230) 00010000:00010000:0.0:1787560706.350173:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.350185:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.350208:0:14298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff93d987fff500) 00010000:00010000:0.0:1787560706.350213:0:14298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787560706.350218:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560706.350225:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c2044600/0xe34191b056740660 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560706.350239:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d98641ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+19:14517:x1874392788367872:12345-192.168.201.56@tcp:35:lhsmtool_posix.0 Request processed in 3315us (3654us total) trans 8589934630 rc 0/0 00010000:00010000:0.0:1787560706.350249:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560706.350252:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 13 00010000:00010000:0.0:1787560706.350269:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560706.350272:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560706.350533:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788368000 00000100:00100000:3.0:1787560706.350544:0:14996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788368000 00000100:00100000:3.0:1787560706.350610:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:3.0:1787560706.350622:0:14996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+7:14516:x1874392788368000:12345-192.168.201.56@tcp:101:bash.0 00010000:00010000:3.0:1787560706.350642:0:14996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560706.350665:0:14996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b50adf29/0xe34191b056740667 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf9284a expref: -99 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560706.350706:0:14996:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8c0301, atime: 0x6a8c02ff, ctime: 0x6a8c0301, blocks: 0x1 00010000:00010000:3.0:1787560706.350738:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1787560706.350745:0:14996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560706.350771:0:14996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b50adf29/0xe34191b056740667 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9284a expref: 8 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.350791:0:14996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b50adf29/0xe34191b056740667 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf9284a expref: 8 pid: 14996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.350805:0:14996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21db400, rc 0) 00000100:00100000:3.0:1787560706.350900:0:14996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:936664d3-5703-46ce-869f-e8a83298bb2c+8:14516:x1874392788368000:12345-192.168.201.56@tcp:101:bash.0 Request processed in 277us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560706.350909:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000020:00080000:2.0:1787560706.351354:0:14313:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787560706.355690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560706.355838:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788368256 00000100:00100000:3.0:1787560706.355980:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788368256 00000100:00100000:3.0:1787560706.356094:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 14 00000100:00100000:3.0:1787560706.356107:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936664d3-5703-46ce-869f-e8a83298bb2c+19:14516:x1874392788368256:12345-192.168.201.56@tcp:35:bash.0 00000001:00080000:3.0:1787560706.356507:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1787560706.356634:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1787560706.356776:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:936664d3-5703-46ce-869f-e8a83298bb2c+22:14516:x1874392788368256:12345-192.168.201.56@tcp:35:bash.0 Request processed in 669us (1098us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1787560706.356786:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 14 00000020:00080000:3.0:1787560706.356792:0:14314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787560706.503806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560706.503970:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788368512 00000100:00100000:3.0:1787560706.503985:0:14311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788368512 00000100:00100000:3.0:1787560706.504207:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:3.0:1787560706.504221:0:14311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+22:14527:x1874392788368512:12345-192.168.201.56@tcp:101:lfs.0 00010000:00010000:3.0:1787560706.504459:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560706.504490:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05674066e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd83d4a1a7cf92851 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560706.504827:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787560706.505071:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05674066e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92851 expref: 24 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.505090:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93d984e44900) 00010000:00010000:3.0:1787560706.505094:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787560706.505100:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9c21dac00/0xe34191b05674066e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.56@tcp remote: 0xd83d4a1a7cf92851 expref: 24 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560706.505117:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93d9c21dac00, rc 0) 00000100:00100000:3.0:1787560706.505460:0:14311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:936664d3-5703-46ce-869f-e8a83298bb2c+23:14527:x1874392788368512:12345-192.168.201.56@tcp:101:lfs.0 Request processed in 1240us (1668us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1787560706.505470:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 61 00000100:00100000:0.0:1787560706.512215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:1.0:1787560706.512380:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788368640 00000100:00100000:1.0:1787560706.512395:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788368640 00000100:00100000:1.0:1787560706.512485:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:1.0:1787560706.512498:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+23:14527:x1874392788368640:12345-192.168.201.56@tcp:34:lfs.0 00010000:00010000:1.0:1787560706.512598:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674067c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.512619:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674067c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.512634:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674067c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.512651:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b056740683 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.512686:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b056740683 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.512694:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b056740683 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513084:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513094:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513101:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787560706.513151:0:14312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513166:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674067c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513172:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674067c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513178:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674067c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513184:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261a00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560706.513189:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674067c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513196:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674067c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513216:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff93d984e44000) 00010000:00010000:1.0:1787560706.513219:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560706.513225:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674067c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513231:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261a00/0xe34191b05674067c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513245:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b056740683 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513265:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b056740683 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513272:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b056740683 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513278:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4260c00 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560706.513281:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b056740683 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513286:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b056740683 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513293:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff93d995c27c00) 00010000:00010000:1.0:1787560706.513295:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560706.513298:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b056740683 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513304:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4260c00/0xe34191b056740683 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513333:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513339:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513345:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513350:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93d9b4261600 already unused, calling callback (ffffffffc21364f0) 00010000:00010000:1.0:1787560706.513353:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513359:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513366:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff93d984e44200) 00010000:00010000:1.0:1787560706.513368:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560706.513371:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560706.513377:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93d9b4261600/0xe34191b05674068a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560706.513498:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:936664d3-5703-46ce-869f-e8a83298bb2c+23:14527:x1874392788368640:12345-192.168.201.56@tcp:34:lfs.0 Request processed in 1000us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560706.513508:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 62 00000100:00100000:2.0:1787560706.518891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560706.519065:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788368896 00000100:00100000:0.0:1787560706.519079:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788368896 00000100:00100000:0.0:1787560706.519160:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 15 00000100:00100000:0.0:1787560706.519173:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+23:14527:x1874392788368896:12345-192.168.201.56@tcp:35:lfs.0 00000100:00100000:0.0:1787560706.519807:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:936664d3-5703-46ce-869f-e8a83298bb2c+24:14527:x1874392788368896:12345-192.168.201.56@tcp:35:lfs.0 Request processed in 633us (974us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1787560706.519825:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 15 00010000:00010000:0.0:1787560706.703316:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560707.728139:0:14298:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560707.793143:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815611904:0@lo:400:kworker.0 00000100:00100000:3.0:1787560707.793238:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560707.793291:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815612416:0@lo:400:kworker.0 00000100:00100000:3.0:1787560707.793316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560707.793343:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560707.793349:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815612032:0@lo:400:kworker.0 00000100:00100000:3.0:1787560707.793370:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560707.793422:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815611904 00000100:00100000:3.0:1787560707.793430:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815611904 00000100:00100000:3.0:1787560707.793480:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815612032 00000100:00100000:3.0:1787560707.793483:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815612032 00000100:00100000:3.0:1787560707.793510:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787560707.793520:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815611904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560707.793581:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874392815611904:12345-0@lo:400:kworker.0 Request processed in 62us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560707.793588:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560707.793604:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449b2653-031b-4a00-838c-f2377a91f8ff:3314:1874392815611776:0@lo:400:kworker.0 00000100:00100000:3.0:1787560707.793608:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560707.793616:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1874392815612032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560707.793654:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560707.793682:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815612160:0@lo:400:kworker.0 00000100:00100000:3.0:1787560707.795116:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1874392815612032:12345-0@lo:400:kworker.0 Request processed in 1493us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560707.795138:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560707.795178:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815612416 00000100:00100000:3.0:1787560707.795185:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815612416 00000100:00100000:3.0:1787560707.795226:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787560707.795235:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815612416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560707.795285:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874392815612416:12345-0@lo:400:kworker.0 Request processed in 52us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560707.795291:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787560707.795316:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560707.795321:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560707.795349:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d987384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815612288:0@lo:400:kworker.0 00000100:00100000:0.0:1787560707.795403:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560707.795588:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815611776 00000100:00100000:0.0:1787560707.795594:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815611776 00000100:00100000:0.0:1787560707.795630:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787560707.795639:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+19:3314:x1874392815611776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560707.795690:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:449b2653-031b-4a00-838c-f2377a91f8ff+19:3314:x1874392815611776:12345-0@lo:400:kworker.0 Request processed in 53us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560707.795697:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787560707.798929:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560707.799426:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815612288 00000100:00100000:2.0:1787560707.799436:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815612288 00000100:00100000:2.0:1787560707.799495:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815612160 00000100:00100000:2.0:1787560707.799498:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815612160 00000100:00100000:2.0:1787560707.799519:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560707.799528:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815612288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560707.799584:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874392815612288:12345-0@lo:400:kworker.0 Request processed in 57us (4194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560707.799590:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560707.799608:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560707.799614:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815612160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560707.799643:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874392815612160:12345-0@lo:400:kworker.0 Request processed in 29us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560707.799648:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787560707.800271:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560707.800307:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874392815612160:0@lo:400:kworker.0 00000100:00100000:0.0:1787560707.801615:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815612544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560707.801686:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560707.801759:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:449b2653-031b-4a00-838c-f2377a91f8ff:3314:1874392815611776:0@lo:400:kworker.0 00000100:00100000:0.0:1787560707.801773:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874392815612288:0@lo:400:kworker.0 00000100:00100000:0.0:1787560707.802092:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815612032:0@lo:400:kworker.0 00000100:00100000:0.0:1787560707.802105:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874392815611904:0@lo:400:kworker.0 00000100:00100000:0.0:1787560707.802117:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d987385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874392815612416:0@lo:400:kworker.0 00000100:00100000:1.0:1787560707.803672:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815612544 00000100:00100000:1.0:1787560707.803686:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815612544 00000100:00100000:1.0:1787560707.803739:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560707.803750:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b3922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874392815612544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787560707.803786:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787560707.803955:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b3922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874392815612544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 206us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560707.803963:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560707.811417:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874392815612544:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787560707.871199:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1787560707.871215:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1787560707.871235:0:7642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:02000400:2.0:1787560707.930280:0:16576:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1787560708.533141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560708.533184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560708.533220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560708.533255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560708.533281:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788369280 00000100:00100000:3.0:1787560708.533282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560708.533293:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788369280 00000100:00100000:3.0:1787560708.533306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560708.533338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:0.0:1787560708.533410:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788369536 00000100:00100000:0.0:1787560708.533416:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788369536 00000100:00100000:1.0:1787560708.533441:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788369024 00000100:00100000:1.0:1787560708.533447:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788369024 00000100:00100000:0.0:1787560708.533456:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788369152 00000100:00100000:0.0:1787560708.533461:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788369152 00000100:00100000:1.0:1787560708.533488:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 122 00000100:00100000:0.0:1787560708.533496:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:1.0:1787560708.533503:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d8813f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:2344:x1874392788369024:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560708.533509:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61328c9-c3e1-4e42-a91a-11289a78c799+6:2344:x1874392788369536:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560708.533583:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a61328c9-c3e1-4e42-a91a-11289a78c799+6:2344:x1874392788369536:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 76us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560708.533584:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d8813f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22884a16-a96e-4dcb-91b8-75d054db9e6f+13:2344:x1874392788369024:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 82us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560708.533600:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 26 00000100:00100000:1.0:1787560708.533601:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 122 00000100:00100000:0.0:1787560708.533628:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00080000:1.0:1787560708.533638:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560708.533645:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560708.533652:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+24:2344:x1874392788369152:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:0.0:1787560708.533689:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:936664d3-5703-46ce-869f-e8a83298bb2c+24:2344:x1874392788369152:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 53us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560708.533706:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 27 00000100:00100000:2.0:1787560708.537878:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788369792 00000100:00100000:2.0:1787560708.537894:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788369792 00000100:00100000:2.0:1787560708.537970:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788369408 00000100:00100000:2.0:1787560708.537974:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788369408 00000100:00100000:2.0:1787560708.537993:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788369664 00000100:00100000:2.0:1787560708.537996:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788369664 00000100:00100000:2.0:1787560708.538023:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:2.0:1787560708.538033:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936664d3-5703-46ce-869f-e8a83298bb2c+5:2344:x1874392788369280:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560708.538388:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936664d3-5703-46ce-869f-e8a83298bb2c+5:2344:x1874392788369280:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 355us (5201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560708.538412:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 18 00000100:00100000:2.0:1787560708.538431:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:2.0:1787560708.538437:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2344:x1874392788369792:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560708.538465:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2344:x1874392788369792:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 29us (5210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560708.538472:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 19 00000100:00100000:2.0:1787560708.538483:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:2.0:1787560708.538489:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936664d3-5703-46ce-869f-e8a83298bb2c+6:2344:x1874392788369408:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560708.538513:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936664d3-5703-46ce-869f-e8a83298bb2c+6:2344:x1874392788369408:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 24us (5207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560708.538519:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:2.0:1787560708.538530:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00100000:2.0:1787560708.538536:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d987384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2344:x1874392788369664:12345-192.168.201.56@tcp:400:kworker.0 00000100:00100000:2.0:1787560708.538557:0:14997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d987384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a61328c9-c3e1-4e42-a91a-11289a78c799+5:2344:x1874392788369664:12345-192.168.201.56@tcp:400:kworker.0 Request processed in 22us (5220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560708.538563:0:14997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 21 00000100:00080000:1.0:1787560708.538636:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560708.538640:0:14306:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787560708.751098:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560708.815295:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815612672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560708.815408:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560708.815602:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392815612672 00000100:00100000:0.0:1787560708.815610:0:14999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392815612672 00000100:00100000:0.0:1787560708.815662:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560708.815673:0:14999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9b4224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815612672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560708.815705:0:14999:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787560708.815753:0:14999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9b4224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874392815612672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560708.815759:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560708.815807:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93d9b3921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874392815612672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560709.562554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:2.0:1787560709.562605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.56@tcp (source: 12345-192.168.201.56@tcp) 00000100:00100000:3.0:1787560709.562721:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788369920 00000100:00100000:3.0:1787560709.562732:0:15001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788369920 00002000:00100000:3.0:1787560709.562780:0:15001:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff93d9baf37800 x1874392788369920/t0(0) o4->936664d3-5703-46ce-869f-e8a83298bb2c@192.168.201.56@tcp:70/0 lens 504/0 e 0 to 0 dl 1787560720 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787560709.562798:0:15001:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9baf37800 with x1874392788369920 ext(0->8) 00002000:00010000:3.0:1787560709.562805:0:15001:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d9baf37800 00000100:00100000:3.0:1787560709.562836:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 0 00000100:00100000:3.0:1787560709.562948:0:15001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:936664d3-5703-46ce-869f-e8a83298bb2c+6:2342:x1874392788369920:12345-192.168.201.56@tcp:4:bash.0 00000100:00100000:3.0:1787560709.563608:0:15001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93d9baf37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:936664d3-5703-46ce-869f-e8a83298bb2c+8:2342:x1874392788369920:12345-192.168.201.56@tcp:4:bash.0 Request processed in 759us (1063us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787560709.563617:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.56@tcp, seq: 0 00002000:00100000:3.0:1787560709.563626:0:15001:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff93d9baf37800 x1874392788369920/t8589934598(0) o4->936664d3-5703-46ce-869f-e8a83298bb2c@192.168.201.56@tcp:70/0 lens 504/448 e 0 to 0 dl 1787560720 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1787560709.563636:0:15001:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff93d9baf37800 with x1874392788369920 ext(0->8) 00002000:00010000:3.0:1787560709.563639:0:15001:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff93d9baf37800 00000100:00100000:0.0:1787560709.568246:0:14997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392788370048 00000100:00100000:0.0:1787560709.568270:0:14997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392788370048 00000100:00100000:1.0:1787560709.568441:0:14997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.56@tcp, seq: 20 00000100:00100000:1.0:1787560709.568453:0:14997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93d9baf34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:936664d3-5703-46ce-869f-e8a83298bb2c+8:2342:x1874392788370048:12345-192.168.201.56@tcp:16:kworker.0 Debug log: 29793 lines, 29793 kept, 0 dropped, 0 bad.